Sep 08 13:40:39 devstack cinder-volume[76325]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 13:40:39 devstack cinder-volume[76325]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 13:40:39 devstack cinder-volume[76325]: we strongly recommend against using it for new projects. Sep 08 13:40:39 devstack cinder-volume[76325]: If you are already using Eventlet, we recommend migrating to a different Sep 08 13:40:39 devstack cinder-volume[76325]: framework. For more detail see Sep 08 13:40:39 devstack cinder-volume[76325]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 13:40:39 devstack cinder-volume[76325]: import eventlet # noqa Sep 08 13:40:41 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 13:40:41 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 13:40:41 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 13:40:42 devstack cinder-volume[76325]: INFO dbcounter [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Registered counter for database cinder Sep 08 13:40:43 devstack cinder-volume[76325]: DEBUG oslo_db.sqlalchemy.engines [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:40:43 devstack cinder-volume[76325]: DEBUG dbcounter [-] [76325] Writer thread running {{(pid=76325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 13:40:43 devstack cinder-volume[76325]: INFO cinder.rpc [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 13:40:43 devstack cinder-volume[76325]: INFO cinder.rpc [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 13:40:43 devstack cinder-volume[76325]: DEBUG oslo_db.sqlalchemy.engines [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:40:43 devstack cinder-volume[76325]: INFO cinder.volume.manager [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Determined volume DB was empty at startup. Sep 08 13:40:43 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76325) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 13:40:43 devstack cinder-volume[76325]: INFO cinder.volume.manager [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 13:40:43 devstack cinder-volume[76325]: WARNING stevedore.named [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 13:40:43 devstack cinder-volume[76325]: WARNING castellan.key_manager [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 13:40:43 devstack cinder-volume[76325]: WARNING cinder.keymgr.conf_key_mgr [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 13:40:43 devstack cinder-volume[76325]: DEBUG cinder.volume.drivers.lvm [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76325) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 08 13:40:43 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:43 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] CMD "cinder-rtstool verify" returned: 0 in 0.419s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_db.sqlalchemy.engines [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:40:44 devstack cinder-volume[76325]: INFO cinder.rpc [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 08 13:40:44 devstack cinder-volume[76325]: INFO cinder.rpc [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 08 13:40:44 devstack cinder-volume[76325]: WARNING stevedore.named [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 13:40:44 devstack cinder-volume[76325]: WARNING castellan.key_manager [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 13:40:44 devstack cinder-volume[76325]: INFO cinder.volume.manager [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_db.sqlalchemy.engines [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:40:44 devstack cinder-volume[76325]: INFO oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Starting 1 workers Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Started child 76478 {{(pid=76325) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Full set of CONF: {{(pid=76325) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] ******************************************************************************** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Configuration options gathered from: {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] ================================================================================ {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] allow_availability_zone_fallback = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] allow_compression_on_image_upload = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76478]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] allowed_direct_url_schemes = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] api_rate_limit = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] auth_strategy = keystone {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] az_cache_duration = 3600 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_availability_zone = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_host = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_stats_polling_interval = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backup_api_class = cinder.backup.api.API {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backup_name_template = backup-%s {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backup_use_same_host = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backup_use_temp_snapshot = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] chap_password = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] chap_username = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_internal_tenant_project_id = 6070e53d489c4bff8851d370e894de06 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_internal_tenant_user_id = 79e09ab5bb444a748404b2903050ce5a {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cloned_volume_same_az = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cluster = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] compression_format = gzip {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] compute_api_class = cinder.compute.nova.API {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] config_dir = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] config_source = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] control_exchange = openstack {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] debug = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] default_availability_zone = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] default_group_type = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] default_volume_type = lvmdriver-1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] disk_geometry = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] driver_client_cert = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] driver_client_cert_key = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] driver_data_namespace = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] driver_ssl_cert_path = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] driver_ssl_cert_verify = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] driver_use_ssl = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] enable_force_upload = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] enable_new_services = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] enable_unsupported_driver = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] enforce_multipath_for_image_xfer = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] filter_function = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_api_insecure = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_api_servers = ['http://192.168.122.142/image'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_api_ssl_compression = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_ca_certificates_file = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_catalog_info = image:glance:publicURL {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_certfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_keyfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_num_retries = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance_request_timeout = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] goodness_function = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] graceful_shutdown_timeout = 5 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] group_api_class = cinder.group.api.API {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] host = devstack {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_compress_on_upload = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_conversion_address_space_limit = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_conversion_cpu_limit = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_conversion_disable = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76478]: INFO cinder.volume.manager [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_upload_use_cinder_backend = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_upload_use_internal_tenant = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_volume_cache_enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_volume_cache_max_count = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] image_volume_cache_max_size_gb = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] init_host_max_objects_retrieval = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] instance_format = [instance: %(uuid)s] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] iscsi_target_flags = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] iscsi_write_cache = on {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] iser_helper = tgtadm {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] iser_ip_address = 192.168.122.142 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] iser_port = 3260 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_color = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_config_append = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_dir = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_file = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_options = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_rotate_interval = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_rotate_interval_type = days {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] log_rotation_type = none {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] max_age = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] max_logfile_count = 30 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] max_logfile_size_mb = 200 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] max_over_subscription_ratio = 20.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] message_reap_interval = 86400 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] message_ttl = 2592000 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] migration_create_volume_timeout_secs = 300 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] monkey_patch = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] monkey_patch_modules = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] my_ip = 192.168.122.142 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] no_snapshot_gb_quota = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] num_iser_scan_tries = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] num_shell_tries = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] num_volume_device_scan_tries = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] nvmeof_conn_info_version = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] nvmet_ns_id = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] nvmet_port_id = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] osapi_max_limit = 1000 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] osapi_volume_ext_list = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] osapi_volume_listen_port = 8776 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] osapi_volume_use_ssl = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] osapi_volume_workers = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] per_volume_size_limit = -1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] periodic_fuzzy_delay = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] periodic_interval = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] public_endpoint = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] publish_errors = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] quota_backup_gigabytes = 1000 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] quota_backups = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] quota_gigabytes = 1000 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] quota_groups = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] quota_snapshots = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] quota_volumes = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] rate_limit_burst = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] rate_limit_except_level = CRITICAL {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] rate_limit_interval = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] reinit_driver_count = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] replication_device = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] report_discard_supported = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] report_interval = 120 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] reservation_clean_interval = 86400 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] reservation_expire = 86400 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] reserved_image_namespaces = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] reserved_percentage = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] rpc_response_timeout = 120 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] run_external_periodic_tasks = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] scst_target_driver = iscsi {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] scst_target_iqn_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_down_time = 720 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] shell_completion = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] snapshot_name_template = snapshot-%s {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] snapshot_same_host = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] split_loggers = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] state_path = /opt/stack/data/cinder {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] storage_availability_zone = nova {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] storage_protocol = iSCSI {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] syslog_log_facility = LOG_USER {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] target_helper = lioadm {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] target_ip_address = 192.168.122.142 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] target_port = 3260 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] target_protocol = iscsi {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] target_secondary_ip_addresses = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] trace_flags = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] transport_url = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] until_refresh = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] use_chap_auth = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] use_default_quota_class = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] use_journal = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] use_json = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] use_multipath_for_image_xfer = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] use_stderr = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] use_syslog = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] verify_glance_signatures = enabled {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_api_class = cinder.volume.api.API {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_backend_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_clear = zero {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_clear_ionice = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_clear_size = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_copy_bps_limit = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_dd_blocksize = 1M {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_name_template = volume-%s {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_service_inithost_offload = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volume_usage_audit_period = month {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] zoning_mode = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_concurrency.disable_process_locking = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.auth_section = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.auth_type = password {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.auth_version = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.cache = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.certfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.include_service_catalog = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.insecure = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.interface = public {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.keyfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_password = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcache_username = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.region_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.service_type = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.142/identity {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.backend = dogpile.cache.null {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.backend_argument = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.backend_expiration_time = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.config_prefix = cache.oslo {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.debug_cache_backend = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.enable_retry_client = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.enable_socket_keepalive = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.expiration_time = 600 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.hashclient_retry_attempts = 2 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.memcache_dead_retry = 300 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.memcache_pool_maxsize = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.memcache_sasl_enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.password = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.proxies = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.redis_db = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.redis_server = localhost:6379 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.retry_attempts = 2 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.retry_delay = 0.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.socket_keepalive_count = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.socket_keepalive_idle = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.socket_keepalive_interval = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.socket_timeout = 1.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.tls_allowed_ciphers = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.tls_cafile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.tls_certfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.tls_enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.tls_keyfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cache.username = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] coordination.backend_url = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.asyncio_connection = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.asyncio_slave_connection = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.backend = sqlalchemy {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.connection = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.connection_debug = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.connection_parameters = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.connection_recycle_time = 3600 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.connection_trace = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.db_inc_retry_interval = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.db_max_retries = 20 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.db_max_retry_interval = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.db_retry_interval = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.max_overflow = 50 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.max_pool_size = 5 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.max_retries = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.mysql_wsrep_sync_wait = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.pool_timeout = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.retry_interval = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.slave_connection = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.sqlite_synchronous = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.synchronous_reader = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] database.use_db_reconnect = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_tracing.insecure = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.connection_string = messaging:// {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.es_doc_type = notification {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.es_scroll_size = 10000 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.es_scroll_time = 2m {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.filter_error_trace = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.hmac_keys = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.sentinel_service_name = mymaster {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.socket_timeout = 0.1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.trace_requests = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler.trace_sqlalchemy = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler_jaeger.process_tags = {} {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler_jaeger.service_name_prefix = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] profiler_otlp.service_name_prefix = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.enforce_new_defaults = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.policy_default_rule = default {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.policy_file = policy.yaml {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] privsep_osbrick.group = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] privsep_osbrick.helper_command = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] privsep_osbrick.user = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_sys_admin.group = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_sys_admin.helper_command = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] cinder_sys_admin.user = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.auth_section = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.auth_type = password {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.cafile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.certfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.collect_timing = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.insecure = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.keyfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.send_service_user_token = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.split_loggers = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.timeout = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.tls_ciphers = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] service_user.tls_min_version = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.auth_section = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.auth_type = password {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.certfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.collect_timing = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.insecure = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.keyfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.region_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.split_loggers = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.timeout = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.tls_ciphers = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] glance.tls_min_version = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.backend_availability_zone = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.chap_password = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.chap_username = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.disk_geometry = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.driver_client_cert = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.driver_client_cert_key = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.driver_data_namespace = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.driver_use_ssl = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.extra_capabilities = {} {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.filter_function = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.goodness_function = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.iscsi_target_flags = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.iscsi_write_cache = on {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.iser_helper = tgtadm {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.iser_ip_address = 192.168.122.142 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.iser_port = 3260 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.lvm_share_target = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.lvm_type = auto {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.num_shell_tries = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.replication_device = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.report_discard_supported = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.reserved_percentage = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.target_helper = tgtadm {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.target_ip_address = 192.168.122.142 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.target_port = 3260 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.target_protocol = iscsi {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.trace_flags = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.unique_fqdn_network = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.use_chap_auth = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_backend_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_clear = zero {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_clear_ionice = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_clear_size = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_reports.file_event_handler = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_reports.log_dir = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.backend_host = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.chap_password = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.chap_username = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.disk_geometry = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.driver_client_cert = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.extra_capabilities = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.filter_function = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.goodness_function = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.iser_helper = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.iser_ip_address = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.iser_port = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.lvm_share_target = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.lvm_type = auto {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.num_shell_tries = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.replication_device = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.report_discard_supported = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.reserved_percentage = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.scst_target_driver = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.storage_protocol = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.target_helper = lioadm {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.target_ip_address = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.target_port = 3260 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.trace_flags = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.use_chap_auth = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_clear = zero {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_clear_size = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] lvmdriver-1.volumes_dir = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.ssl = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_notifications.driver = [] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_notifications.retry = -1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] key_manager.fixed_key = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.barbican_api_version = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.barbican_endpoint = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.barbican_endpoint_type = public {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.barbican_region_name = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.cafile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.certfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.collect_timing = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.insecure = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.keyfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.number_of_retries = 60 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.retry_delay = 1 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.send_service_user_token = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.split_loggers = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.timeout = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.tls_ciphers = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.tls_min_version = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.verify_ssl = True {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican.verify_ssl_path = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.auth_section = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.auth_type = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.cafile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.certfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.collect_timing = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.insecure = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.keyfile = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.split_loggers = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.timeout = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.tls_ciphers = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] barbican_service_user.tls_min_version = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.approle_role_id = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.approle_secret_id = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.auth_method = approle {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.auth_path = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.kv_mountpoint = secret {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.kv_path = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.kv_version = 2 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.namespace = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.root_token_id = **** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.ssl_ca_crt_file = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.timeout = 60.0 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.token_file = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.token_role = None {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.use_ssl = False {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:40:44 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] ******************************************************************************** {{(pid=76325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 13:40:44 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.383s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:44 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:44 devstack sudo[76486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:44 devstack sudo[76486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:45 devstack sudo[76486]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.283s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:40:45 devstack cinder-volume[76478]: INFO cinder.brick.local_dev.lvm [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:45 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:40:45 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:45 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG cinder.brick.local_dev.lvm [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76478) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:45 devstack sudo[76654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:45 devstack sudo[76654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:45 devstack sudo[76654]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.535s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:45 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:45 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:45 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:46 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:46 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:46 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:46 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:46 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:46 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 08 13:40:46 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:46 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:46 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.275s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:46 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:46 devstack sudo[77021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:40:46 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:46 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:46 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:46 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:46 devstack sudo[77100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:40:46 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:47 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:47 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:47 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:47 devstack sudo[77109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:40:47 devstack sudo[77109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:47 devstack sudo[77109]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:47 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.352s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:47 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:47 devstack sudo[77188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:47 devstack sudo[77188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:47 devstack sudo[77188]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:47 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:47 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:47 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:47 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:47 devstack sudo[77198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:47 devstack sudo[77198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:48 devstack sudo[77198]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.361s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:48 devstack cinder-volume[76478]: INFO cinder.volume.drivers.lvm [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:48 devstack sudo[77282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:48 devstack sudo[77282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:48 devstack sudo[77282]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG cinder.volume.drivers.lvm [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Updating volume stats {{(pid=76478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:48 devstack sudo[77291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:40:48 devstack sudo[77291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:48 devstack sudo[77291]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:48 devstack sudo[77294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:40:48 devstack sudo[77294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:48 devstack sudo[77294]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:48 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:48 devstack sudo[77297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:48 devstack sudo[77297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:49 devstack sudo[77297]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:49 devstack sudo[77300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:40:49 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:49 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:49 devstack cinder-volume[76478]: INFO cinder.volume.driver [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG cinder.volume.driver [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76478) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG oslo_db.sqlalchemy.engines [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG dbcounter [-] [76478] Writer thread running {{(pid=76478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG cinder.db.api [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Building query based on filter {{(pid=76478) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG cinder.image.image_utils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76478) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 13:40:49 devstack cinder-volume[76478]: INFO cinder.keymgr.migration [None req-2766c64b-c055-4d6c-9dd6-86729834447d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG cinder.volume.drivers.lvm [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Updating volume stats {{(pid=76478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:49 devstack sudo[77304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:40:49 devstack sudo[77304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:49 devstack sudo[77304]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:49 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:49 devstack sudo[77307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:40:49 devstack sudo[77307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:50 devstack sudo[77307]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:50 devstack sudo[77312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:50 devstack sudo[77312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:50 devstack sudo[77312]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:50 devstack sudo[77316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:40:50 devstack sudo[77316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:50 devstack sudo[77316]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG cinder.manager [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Notifying Schedulers of capabilities ... {{(pid=76478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:40:50 devstack cinder-volume[76478]: INFO cinder.volume.manager [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Driver initialization completed successfully. Sep 08 13:40:50 devstack cinder-volume[76478]: INFO cinder.manager [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Initiating service 2 cleanup Sep 08 13:40:50 devstack cinder-volume[76478]: INFO cinder.manager [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Service 2 cleanup completed. Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG cinder.service [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Creating RPC server for service cinder-volume {{(pid=76478) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG cinder.service [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76478) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 13:40:50 devstack cinder-volume[76478]: INFO cinder.volume.manager [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG cinder.volume.drivers.lvm [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Updating volume stats {{(pid=76478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 13:40:50 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:50 devstack sudo[77319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:40:50 devstack sudo[77319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:51 devstack sudo[77319]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:51 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:51 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:51 devstack sudo[77322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:40:51 devstack sudo[77322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:51 devstack sudo[77322]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:51 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:51 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:51 devstack sudo[77330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:40:51 devstack sudo[77330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:51 devstack sudo[77330]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:51 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:51 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:40:51 devstack sudo[77333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:40:51 devstack sudo[77333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:40:51 devstack sudo[77333]: pam_unix(sudo:session): session closed for user root Sep 08 13:40:51 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:40:52 devstack cinder-volume[76478]: INFO cinder.volume.manager [None req-52febdd8-e86c-4ecb-ae88-22b861eaf7f0 None None] Driver post RPC initialization completed successfully. Sep 08 13:40:54 devstack cinder-volume[76325]: DEBUG dbcounter [-] [76325] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:41:01 devstack cinder-volume[76478]: DEBUG dbcounter [-] [76478] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:41:02 devstack cinder-volume[76478]: DEBUG dbcounter [-] [76478] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:41:15 devstack cinder-volume[76478]: DEBUG oslo_service.periodic_task [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running periodic task VolumeManager._thread_info {{(pid=76478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:41:15 devstack cinder-volume[76478]: DEBUG cinder.volume.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] thread count: 6 {{(pid=76478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:41:15 devstack cinder-volume[76478]: DEBUG cinder.volume.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] thread info: [<_MainThread(MainThread, started 130208228479104)>, , , , , ] {{(pid=76478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG oslo_service.periodic_task [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG cinder.volume.drivers.lvm [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Updating volume stats {{(pid=76478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:42:15 devstack sudo[79973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:42:15 devstack sudo[79973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:42:15 devstack sudo[79973]: pam_unix(sudo:session): session closed for user root Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:42:15 devstack sudo[79976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:42:15 devstack sudo[79976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:42:15 devstack sudo[79976]: pam_unix(sudo:session): session closed for user root Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:42:15 devstack sudo[79979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:42:15 devstack sudo[79979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:42:15 devstack sudo[79979]: pam_unix(sudo:session): session closed for user root Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:42:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:42:15 devstack sudo[79982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:42:15 devstack sudo[79982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:42:16 devstack sudo[79982]: pam_unix(sudo:session): session closed for user root Sep 08 13:42:16 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:42:16 devstack cinder-volume[76478]: DEBUG cinder.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Notifying Schedulers of capabilities ... {{(pid=76478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:42:16 devstack cinder-volume[76478]: DEBUG oslo_service.periodic_task [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running periodic task VolumeManager._thread_info {{(pid=76478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:42:16 devstack cinder-volume[76478]: DEBUG cinder.volume.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] thread count: 6 {{(pid=76478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:42:16 devstack cinder-volume[76478]: DEBUG cinder.volume.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] thread info: [<_MainThread(MainThread, started 130208228479104)>, , , , , ] {{(pid=76478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:43:02 devstack cinder-volume[76478]: DEBUG dbcounter [-] [76478] Writing DB stats cinder:SELECT=1 {{(pid=76478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:43:02 devstack cinder-volume[76478]: DEBUG dbcounter [-] [76478] Writing DB stats cinder:UPDATE=1 {{(pid=76478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG oslo_service.periodic_task [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG cinder.volume.drivers.lvm [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Updating volume stats {{(pid=76478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:43:15 devstack sudo[83204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:43:15 devstack sudo[83204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:43:15 devstack sudo[83204]: pam_unix(sudo:session): session closed for user root Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:43:15 devstack sudo[83221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:43:15 devstack sudo[83221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:43:15 devstack sudo[83221]: pam_unix(sudo:session): session closed for user root Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:43:15 devstack sudo[83224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:43:15 devstack sudo[83224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:43:15 devstack sudo[83224]: pam_unix(sudo:session): session closed for user root Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:43:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:43:15 devstack sudo[83227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:43:15 devstack sudo[83227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:43:16 devstack sudo[83227]: pam_unix(sudo:session): session closed for user root Sep 08 13:43:16 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:43:16 devstack cinder-volume[76478]: DEBUG cinder.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Notifying Schedulers of capabilities ... {{(pid=76478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG oslo_service.periodic_task [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG cinder.volume.drivers.lvm [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Updating volume stats {{(pid=76478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:44:15 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 13:44:15 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:44:15 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:44:15 devstack sudo[85302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:44:15 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:44:15 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:44:15 devstack sudo[85306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 13:44:15 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:44:15 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:44:15 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:44:15 devstack sudo[85309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 13:44:15 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:44:16 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root Sep 08 13:44:16 devstack cinder-volume[76478]: DEBUG oslo_concurrency.processutils [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:44:16 devstack cinder-volume[76478]: DEBUG cinder.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Notifying Schedulers of capabilities ... {{(pid=76478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:44:16 devstack cinder-volume[76478]: DEBUG oslo_service.periodic_task [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] Running periodic task VolumeManager._thread_info {{(pid=76478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:44:16 devstack cinder-volume[76478]: DEBUG cinder.volume.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] thread count: 6 {{(pid=76478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:44:16 devstack cinder-volume[76478]: DEBUG cinder.volume.manager [None req-68e0761e-f409-4a5d-b241-863fd10982c9 None None] thread info: [<_MainThread(MainThread, started 130208228479104)>, , , , , ] {{(pid=76478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:45:02 devstack cinder-volume[76478]: DEBUG dbcounter [-] [76478] Writing DB stats cinder:SELECT=1 {{(pid=76478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:45:02 devstack cinder-volume[76478]: DEBUG dbcounter [-] [76478] Writing DB stats cinder:UPDATE=1 {{(pid=76478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:45:10 devstack cinder-volume[76325]: INFO oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Caught SIGTERM, stopping children Sep 08 13:45:10 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Acquiring lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 13:45:10 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Acquired lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 13:45:10 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Releasing lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 13:45:10 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Stop services. {{(pid=76325) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 13:45:10 devstack cinder-volume[76325]: DEBUG oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Killing children. {{(pid=76325) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 13:45:10 devstack cinder-volume[76325]: INFO oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Waiting on 1 children to exit Sep 08 13:45:10 devstack cinder-volume[76478]: DEBUG oslo_concurrency.lockutils [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Acquiring lock "singleton_lock" {{(pid=76478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 13:45:10 devstack cinder-volume[76478]: DEBUG oslo_concurrency.lockutils [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Acquired lock "singleton_lock" {{(pid=76478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 13:45:10 devstack cinder-volume[76478]: DEBUG oslo_concurrency.lockutils [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Releasing lock "singleton_lock" {{(pid=76478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 13:45:10 devstack cinder-volume[76478]: WARNING amqp [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 13:45:10 devstack cinder-volume[76478]: WARNING amqp [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 13:45:10 devstack cinder-volume[76325]: INFO oslo_service.backend._eventlet.service [None req-fb21e22a-7624-4d7b-91d6-59fa46e22a06 None None] Child 76478 exited with status 0 Sep 08 13:45:11 devstack cinder-volume[86462]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 13:45:11 devstack cinder-volume[86462]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 13:45:11 devstack cinder-volume[86462]: we strongly recommend against using it for new projects. Sep 08 13:45:11 devstack cinder-volume[86462]: If you are already using Eventlet, we recommend migrating to a different Sep 08 13:45:11 devstack cinder-volume[86462]: framework. For more detail see Sep 08 13:45:11 devstack cinder-volume[86462]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 13:45:11 devstack cinder-volume[86462]: import eventlet # noqa Sep 08 13:45:13 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 13:45:13 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 13:45:13 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 13:45:13 devstack cinder-volume[86462]: INFO dbcounter [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Registered counter for database cinder Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG dbcounter [-] [86462] Writer thread running {{(pid=86462) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 13:45:14 devstack cinder-volume[86462]: INFO cinder.rpc [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 13:45:14 devstack cinder-volume[86462]: INFO cinder.rpc [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:45:14 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Determined volume DB was empty at startup. Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG cinder.volume.manager [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86462) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 13:45:14 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 13:45:14 devstack cinder-volume[86462]: WARNING stevedore.named [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 13:45:14 devstack cinder-volume[86462]: WARNING castellan.key_manager [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 13:45:14 devstack cinder-volume[86462]: WARNING cinder.keymgr.conf_key_mgr [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 13:45:14 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:45:14 devstack cinder-volume[86462]: INFO oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Starting 1 workers Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Started child 86679 {{(pid=86462) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Full set of CONF: {{(pid=86462) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] ******************************************************************************** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Configuration options gathered from: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] ================================================================================ {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] allow_availability_zone_fallback = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] allow_compression_on_image_upload = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] allowed_direct_url_schemes = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] api_rate_limit = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] auth_strategy = keystone {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_availability_zone = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_host = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_stats_polling_interval = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backup_api_class = cinder.backup.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backup_name_template = backup-%s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backup_use_same_host = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backup_use_temp_snapshot = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] chap_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] chap_username = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_internal_tenant_project_id = 6070e53d489c4bff8851d370e894de06 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_internal_tenant_user_id = 79e09ab5bb444a748404b2903050ce5a {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cluster = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] compression_format = gzip {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] compute_api_class = cinder.compute.nova.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] config_dir = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] config_source = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] control_exchange = openstack {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] debug = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] default_availability_zone = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] default_group_type = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86679]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] default_volume_type = QuobyteHD {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] disk_geometry = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] driver_client_cert = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] driver_client_cert_key = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] driver_data_namespace = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] driver_ssl_cert_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] driver_ssl_cert_verify = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] driver_use_ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] enable_new_services = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] enable_unsupported_driver = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] enabled_backends = ['QuobyteHD'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] enforce_multipath_for_image_xfer = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] filter_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_api_insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_api_servers = ['http://192.168.122.142/image'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_api_ssl_compression = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_ca_certificates_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_catalog_info = image:glance:publicURL {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_num_retries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance_request_timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] goodness_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] graceful_shutdown_timeout = 5 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] group_api_class = cinder.group.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] host = devstack {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_compress_on_upload = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_conversion_address_space_limit = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_conversion_cpu_limit = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_conversion_disable = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_upload_use_cinder_backend = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_upload_use_internal_tenant = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_volume_cache_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_volume_cache_max_count = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] image_volume_cache_max_size_gb = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] init_host_max_objects_retrieval = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] instance_format = [instance: %(uuid)s] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] iscsi_target_flags = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] iscsi_write_cache = on {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] iser_helper = tgtadm {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] iser_ip_address = 192.168.122.142 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] iser_port = 3260 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_color = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_config_append = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_dir = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_options = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_rotate_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_rotate_interval_type = days {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] log_rotation_type = none {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] max_age = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] max_logfile_count = 30 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] max_logfile_size_mb = 200 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] max_over_subscription_ratio = 20.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] message_reap_interval = 86400 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] message_ttl = 2592000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] migration_create_volume_timeout_secs = 300 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] monkey_patch = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] monkey_patch_modules = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] my_ip = 192.168.122.142 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] no_snapshot_gb_quota = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] num_iser_scan_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] num_shell_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] num_volume_device_scan_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] nvmeof_conn_info_version = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] nvmet_ns_id = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] nvmet_port_id = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] osapi_max_limit = 1000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] osapi_volume_ext_list = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] osapi_volume_listen_port = 8776 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] osapi_volume_use_ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] osapi_volume_workers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] per_volume_size_limit = -1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] periodic_fuzzy_delay = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] periodic_interval = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] public_endpoint = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] publish_errors = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] quota_backup_gigabytes = 1000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] quota_backups = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] quota_gigabytes = 1000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] quota_groups = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] quota_snapshots = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] quota_volumes = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] rate_limit_burst = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] rate_limit_except_level = CRITICAL {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] rate_limit_interval = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] reinit_driver_count = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] replication_device = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] report_discard_supported = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] report_interval = 120 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] reservation_clean_interval = 86400 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] reservation_expire = 86400 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] reserved_image_namespaces = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] reserved_percentage = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] rpc_response_timeout = 120 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] run_external_periodic_tasks = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] scst_target_driver = iscsi {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] scst_target_iqn_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_down_time = 720 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] shell_completion = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] snapshot_name_template = snapshot-%s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] state_path = /opt/stack/data/cinder {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] storage_availability_zone = nova {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] storage_protocol = iSCSI {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] syslog_log_facility = LOG_USER {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] target_helper = lioadm {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] target_ip_address = 192.168.122.142 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] target_port = 3260 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] target_protocol = iscsi {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] target_secondary_ip_addresses = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] trace_flags = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] transport_url = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] until_refresh = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] use_chap_auth = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] use_default_quota_class = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] use_journal = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] use_json = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] use_multipath_for_image_xfer = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] use_stderr = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] use_syslog = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] verify_glance_signatures = enabled {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_api_class = cinder.volume.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_backend_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_clear = zero {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_clear_ionice = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_clear_size = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_copy_bps_limit = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_dd_blocksize = 1M {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_name_template = volume-%s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_service_inithost_offload = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volume_usage_audit_period = month {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] zoning_mode = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_concurrency.disable_process_locking = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 13:45:14 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.remotefs [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86679) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.auth_section = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.auth_type = password {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.auth_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.cache = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.include_service_catalog = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.interface = public {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcache_username = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.region_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.service_type = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.142/identity {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.backend = dogpile.cache.null {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.backend_argument = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.backend_expiration_time = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.config_prefix = cache.oslo {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.debug_cache_backend = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.enable_retry_client = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.enable_socket_keepalive = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.expiration_time = 600 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.hashclient_retry_attempts = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.memcache_dead_retry = 300 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:14 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.memcache_pool_maxsize = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.memcache_sasl_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.proxies = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.redis_db = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.redis_server = localhost:6379 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.retry_attempts = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.retry_delay = 0.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.socket_keepalive_count = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.socket_keepalive_idle = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.socket_keepalive_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.socket_timeout = 1.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.tls_allowed_ciphers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.tls_cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.tls_certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.tls_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.tls_keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cache.username = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] coordination.backend_url = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.asyncio_connection = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.asyncio_slave_connection = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.backend = sqlalchemy {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.connection = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.connection_debug = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.connection_parameters = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.connection_recycle_time = 3600 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.connection_trace = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.db_inc_retry_interval = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.db_max_retries = 20 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.db_max_retry_interval = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.db_retry_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.max_overflow = 50 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.max_pool_size = 5 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.max_retries = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.mysql_wsrep_sync_wait = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.pool_timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.retry_interval = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.slave_connection = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.sqlite_synchronous = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.synchronous_reader = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] database.use_db_reconnect = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_tracing.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.connection_string = messaging:// {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.es_doc_type = notification {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.es_scroll_size = 10000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.es_scroll_time = 2m {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.filter_error_trace = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.hmac_keys = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.sentinel_service_name = mymaster {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.socket_timeout = 0.1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.trace_requests = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler.trace_sqlalchemy = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler_jaeger.process_tags = {} {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler_jaeger.service_name_prefix = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] profiler_otlp.service_name_prefix = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.enforce_new_defaults = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.policy_default_rule = default {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.policy_file = policy.yaml {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] privsep_osbrick.group = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] privsep_osbrick.helper_command = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] privsep_osbrick.user = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_sys_admin.group = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_sys_admin.helper_command = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] cinder_sys_admin.user = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.auth_section = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.auth_type = password {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86679) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 13:45:15 devstack cinder-volume[86679]: WARNING cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 13:45:15 devstack cinder-volume[86679]: WARNING cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Running cmd (subprocess): mount.quobyte {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.collect_timing = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.send_service_user_token = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.tls_ciphers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] service_user.tls_min_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.auth_section = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.auth_type = password {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.collect_timing = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.region_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.tls_ciphers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] glance.tls_min_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.backend_availability_zone = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.chap_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.chap_username = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.disk_geometry = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.driver_client_cert = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.driver_client_cert_key = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.driver_data_namespace = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.driver_use_ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.extra_capabilities = {} {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.filter_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.goodness_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.iscsi_target_flags = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.iscsi_write_cache = on {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.iser_helper = tgtadm {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.iser_ip_address = 192.168.122.142 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.iser_port = 3260 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_host = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_login = admin {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_mount_options = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_private_key = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_share_path = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.num_shell_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.quobyte_volume_url = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.replication_device = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.report_discard_supported = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.reserved_percentage = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.target_helper = tgtadm {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.target_ip_address = 192.168.122.142 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.target_port = 3260 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.target_protocol = iscsi {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.trace_flags = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.unique_fqdn_network = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.use_chap_auth = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volume_backend_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volume_clear = zero {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volume_clear_ionice = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volume_clear_size = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_reports.file_event_handler = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_reports.log_dir = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.backend_availability_zone = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.backend_host = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.chap_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.chap_username = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.chiscsi_conf = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.disk_geometry = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.driver_client_cert = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.driver_data_namespace = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.driver_use_ssl = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.extra_capabilities = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.filter_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.goodness_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.iser_helper = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.iser_ip_address = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.iser_port = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.iser_target_prefix = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_host = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_login = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_mount_options = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_private_key = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_share_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_ssh_port = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.num_shell_tries = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.nvmet_port_id = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack quobyte-client[86680]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 13:45:15 devstack quobyte-client[86680]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.replication_device = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.report_discard_supported = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.reserved_percentage = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] CMD "mount.quobyte" returned: 1 in 0.140s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.scst_target_driver = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.storage_protocol = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.target_helper = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.target_ip_address = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.target_port = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.target_prefix = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.target_protocol = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.trace_flags = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86679]: INFO cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 ... Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.use_chap_auth = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volume_clear = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 -c /etc/quobyte/client-cinder.cfg {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volume_clear_size = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] QuobyteHD.volumes_dir = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_notifications.driver = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_notifications.retry = -1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] key_manager.fixed_key = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.barbican_api_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.barbican_endpoint = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.barbican_endpoint_type = public {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.barbican_region_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.collect_timing = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.number_of_retries = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.retry_delay = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.send_service_user_token = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.tls_ciphers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.tls_min_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.verify_ssl = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican.verify_ssl_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.auth_section = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.auth_type = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 -c /etc/quobyte/client-cinder.cfg Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.collect_timing = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.tls_ciphers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] barbican_service_user.tls_min_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.approle_role_id = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.approle_secret_id = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.auth_method = approle {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.auth_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.kv_mountpoint = secret {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.kv_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.kv_version = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.namespace = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.root_token_id = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.ssl_ca_crt_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.timeout = 60.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.token_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.token_role = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.use_ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:15 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] ******************************************************************************** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 13:45:15 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.439s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:15 devstack cinder-volume[86679]: INFO cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 succeeded Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.460s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:15 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:45:15 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:45:15 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.234s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:15 devstack cinder-volume[86679]: INFO cinder.volume.driver [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG cinder.volume.driver [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5277252197266, 'free_capacity_gb': 1773.5277252197266, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86679) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 13:45:15 devstack cinder-volume[86679]: DEBUG oslo_db.sqlalchemy.engines [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86679) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG dbcounter [-] [86679] Writer thread running {{(pid=86679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.db.api [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Building query based on filter {{(pid=86679) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.image.image_utils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86679) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 13:45:16 devstack cinder-volume[86679]: INFO cinder.keymgr.migration [None req-c543ed0e-5c89-4609-98c4-622982d31582 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:16 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:45:16 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:45:16 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.227s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.manager [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Notifying Schedulers of capabilities ... {{(pid=86679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:45:16 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Driver initialization completed successfully. Sep 08 13:45:16 devstack cinder-volume[86679]: INFO cinder.manager [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Initiating service 3 cleanup Sep 08 13:45:16 devstack cinder-volume[86679]: INFO cinder.manager [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Service 3 cleanup completed. Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.service [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Creating RPC server for service cinder-volume {{(pid=86679) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.service [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86679) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 13:45:16 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:16 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:45:16 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:45:16 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Sep 08 13:45:16 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.260s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:16 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-749ddbe9-ce3e-4a9b-8415-c6b0526ca985 None None] Driver post RPC initialization completed successfully. Sep 08 13:45:21 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a7e00166-fffd-4297-92a5-cd0ec115a4fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:45:21 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a7e00166-fffd-4297-92a5-cd0ec115a4fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:45:21 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a7e00166-fffd-4297-92a5-cd0ec115a4fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:45:21 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a7e00166-fffd-4297-92a5-cd0ec115a4fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:45:21 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a7e00166-fffd-4297-92a5-cd0ec115a4fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:45:21 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a7e00166-fffd-4297-92a5-cd0ec115a4fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:21 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:45:21 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:45:21 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Sep 08 13:45:21 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a7e00166-fffd-4297-92a5-cd0ec115a4fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.270s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:21 devstack cinder-volume[86679]: DEBUG cinder.manager [None req-a7e00166-fffd-4297-92a5-cd0ec115a4fe None None] Notifying Schedulers of capabilities ... {{(pid=86679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:45:21 devstack cinder-volume[86462]: INFO oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Caught SIGTERM, stopping children Sep 08 13:45:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Acquiring lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 13:45:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Acquired lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 13:45:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Releasing lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 13:45:21 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Stop services. {{(pid=86462) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 13:45:21 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Killing children. {{(pid=86462) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 13:45:21 devstack cinder-volume[86462]: INFO oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Waiting on 1 children to exit Sep 08 13:45:24 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Acquiring lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 13:45:24 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Acquired lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 13:45:24 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Releasing lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 13:45:24 devstack cinder-volume[86679]: WARNING amqp [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 13:45:24 devstack cinder-volume[86679]: WARNING amqp [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 13:45:24 devstack cinder-volume[86462]: INFO oslo_service.backend._eventlet.service [None req-ef7490cc-cb28-46ef-853c-3851e58c4c97 None None] Child 86679 exited with status 0 Sep 08 13:45:25 devstack cinder-volume[86963]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 13:45:25 devstack cinder-volume[86963]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 13:45:25 devstack cinder-volume[86963]: we strongly recommend against using it for new projects. Sep 08 13:45:25 devstack cinder-volume[86963]: If you are already using Eventlet, we recommend migrating to a different Sep 08 13:45:25 devstack cinder-volume[86963]: framework. For more detail see Sep 08 13:45:25 devstack cinder-volume[86963]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 13:45:25 devstack cinder-volume[86963]: import eventlet # noqa Sep 08 13:45:28 devstack cinder-volume[86963]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86963) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 13:45:28 devstack cinder-volume[86963]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86963) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 13:45:28 devstack cinder-volume[86963]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86963) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 13:45:28 devstack cinder-volume[86963]: INFO dbcounter [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Registered counter for database cinder Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG dbcounter [-] [86963] Writer thread running {{(pid=86963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 13:45:29 devstack cinder-volume[86963]: INFO cinder.rpc [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 13:45:29 devstack cinder-volume[86963]: INFO cinder.rpc [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:45:29 devstack cinder-volume[86963]: INFO cinder.volume.manager [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Determined volume DB was empty at startup. Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG cinder.volume.manager [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86963) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 13:45:29 devstack cinder-volume[86963]: WARNING stevedore.named [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 13:45:29 devstack cinder-volume[86963]: WARNING castellan.key_manager [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 13:45:29 devstack cinder-volume[86963]: WARNING cinder.keymgr.conf_key_mgr [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 13:45:29 devstack cinder-volume[86963]: INFO cinder.volume.manager [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:45:29 devstack cinder-volume[86963]: INFO oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Starting 1 workers Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Started child 87262 {{(pid=86963) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Full set of CONF: {{(pid=86963) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] ******************************************************************************** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] Configuration options gathered from: {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 13:45:29 devstack cinder-volume[87262]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] ================================================================================ {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] allow_availability_zone_fallback = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] allow_compression_on_image_upload = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] allowed_direct_url_schemes = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] api_rate_limit = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] auth_strategy = keystone {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_availability_zone = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_host = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_stats_polling_interval = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backup_api_class = cinder.backup.api.API {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backup_name_template = backup-%s {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backup_use_same_host = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backup_use_temp_snapshot = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] chap_password = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] chap_username = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_internal_tenant_project_id = 6070e53d489c4bff8851d370e894de06 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_internal_tenant_user_id = 79e09ab5bb444a748404b2903050ce5a {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cluster = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] compression_format = gzip {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] compute_api_class = cinder.compute.nova.API {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] config_dir = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] config_source = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] control_exchange = openstack {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] debug = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] default_availability_zone = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] default_group_type = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] default_volume_type = QuobyteHD {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] disk_geometry = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] driver_client_cert = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] driver_client_cert_key = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] driver_data_namespace = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] driver_ssl_cert_path = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] driver_ssl_cert_verify = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] driver_use_ssl = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] enable_new_services = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] enable_unsupported_driver = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] enabled_backends = ['QuobyteHD'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] enforce_multipath_for_image_xfer = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] filter_function = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_api_insecure = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_api_servers = ['http://192.168.122.142/image'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_api_ssl_compression = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_ca_certificates_file = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_catalog_info = image:glance:publicURL {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_certfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_keyfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_num_retries = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance_request_timeout = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] goodness_function = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] graceful_shutdown_timeout = 5 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] group_api_class = cinder.group.api.API {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] host = devstack {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_compress_on_upload = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_conversion_address_space_limit = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_conversion_cpu_limit = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_conversion_disable = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_upload_use_cinder_backend = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_upload_use_internal_tenant = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_volume_cache_enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_volume_cache_max_count = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] image_volume_cache_max_size_gb = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] init_host_max_objects_retrieval = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] instance_format = [instance: %(uuid)s] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] iscsi_target_flags = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] iscsi_write_cache = on {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] iser_helper = tgtadm {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] iser_ip_address = 192.168.122.142 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] iser_port = 3260 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_color = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_config_append = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87262) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_dir = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_file = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_options = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_rotate_interval = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_rotate_interval_type = days {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] log_rotation_type = none {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] max_age = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] max_logfile_count = 30 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] max_logfile_size_mb = 200 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] max_over_subscription_ratio = 20.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] message_reap_interval = 86400 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] message_ttl = 2592000 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] migration_create_volume_timeout_secs = 300 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] monkey_patch = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] monkey_patch_modules = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] my_ip = 192.168.122.142 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] no_snapshot_gb_quota = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] num_iser_scan_tries = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] num_shell_tries = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] num_volume_device_scan_tries = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] nvmeof_conn_info_version = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] nvmet_ns_id = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] nvmet_port_id = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] osapi_max_limit = 1000 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] osapi_volume_ext_list = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] osapi_volume_listen_port = 8776 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] osapi_volume_use_ssl = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] osapi_volume_workers = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] per_volume_size_limit = -1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] periodic_fuzzy_delay = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] periodic_interval = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] public_endpoint = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] publish_errors = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] quota_backup_gigabytes = 1000 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] quota_backups = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] quota_gigabytes = 1000 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] quota_groups = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] quota_snapshots = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] quota_volumes = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] rate_limit_burst = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] rate_limit_except_level = CRITICAL {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] rate_limit_interval = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] reinit_driver_count = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] replication_device = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] report_discard_supported = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] report_interval = 120 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] reservation_clean_interval = 86400 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] reservation_expire = 86400 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] reserved_image_namespaces = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] reserved_percentage = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] rpc_response_timeout = 120 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] run_external_periodic_tasks = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] scst_target_driver = iscsi {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] scst_target_iqn_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_down_time = 720 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] shell_completion = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] snapshot_name_template = snapshot-%s {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] split_loggers = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] state_path = /opt/stack/data/cinder {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] storage_availability_zone = nova {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] storage_protocol = iSCSI {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] syslog_log_facility = LOG_USER {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] target_helper = lioadm {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] target_ip_address = 192.168.122.142 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] target_port = 3260 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] target_protocol = iscsi {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] target_secondary_ip_addresses = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] trace_flags = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] transport_url = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] until_refresh = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] use_chap_auth = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] use_default_quota_class = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] use_journal = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] use_json = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] use_multipath_for_image_xfer = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] use_stderr = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] use_syslog = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] verify_glance_signatures = enabled {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_api_class = cinder.volume.api.API {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_backend_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_clear = zero {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_clear_ionice = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_clear_size = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_copy_bps_limit = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_dd_blocksize = 1M {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_name_template = volume-%s {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_service_inithost_offload = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volume_usage_audit_period = month {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] zoning_mode = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_concurrency.disable_process_locking = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.auth_section = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.auth_type = password {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.auth_version = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.cache = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.certfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.include_service_catalog = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87262) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 13:45:29 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 13:45:29 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 13:45:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Running cmd (subprocess): mount.quobyte {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.insecure = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.interface = public {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.keyfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_password = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcache_username = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.region_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.service_type = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.142/identity {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.backend = dogpile.cache.null {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.backend_argument = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.backend_expiration_time = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.config_prefix = cache.oslo {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.debug_cache_backend = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.enable_retry_client = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.enable_socket_keepalive = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.expiration_time = 600 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.hashclient_retry_attempts = 2 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.memcache_dead_retry = 300 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.memcache_pool_maxsize = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.memcache_sasl_enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.password = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.proxies = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.redis_db = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.redis_server = localhost:6379 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.retry_attempts = 2 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.retry_delay = 0.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.socket_keepalive_count = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.socket_keepalive_idle = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.socket_keepalive_interval = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.socket_timeout = 1.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.tls_allowed_ciphers = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.tls_cafile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.tls_certfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.tls_enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.tls_keyfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cache.username = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] coordination.backend_url = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.asyncio_connection = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.asyncio_slave_connection = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.backend = sqlalchemy {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.connection = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.connection_debug = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.connection_parameters = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.connection_recycle_time = 3600 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.connection_trace = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.db_inc_retry_interval = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.db_max_retries = 20 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.db_max_retry_interval = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.db_retry_interval = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.max_overflow = 50 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.max_pool_size = 5 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.max_retries = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.mysql_wsrep_sync_wait = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.pool_timeout = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.retry_interval = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.slave_connection = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.sqlite_synchronous = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.synchronous_reader = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] database.use_db_reconnect = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_tracing.insecure = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.connection_string = messaging:// {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.es_doc_type = notification {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.es_scroll_size = 10000 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.es_scroll_time = 2m {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.filter_error_trace = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.hmac_keys = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.sentinel_service_name = mymaster {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.socket_timeout = 0.1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.trace_requests = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler.trace_sqlalchemy = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler_jaeger.process_tags = {} {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler_jaeger.service_name_prefix = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] profiler_otlp.service_name_prefix = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.enforce_new_defaults = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.policy_default_rule = default {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.policy_file = policy.yaml {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack quobyte-client[87263]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] privsep_osbrick.group = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] privsep_osbrick.helper_command = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack quobyte-client[87263]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] privsep_osbrick.user = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_sys_admin.group = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_sys_admin.helper_command = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:45:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:45:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] cinder_sys_admin.user = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.auth_section = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.auth_type = password {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.cafile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.certfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.collect_timing = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.insecure = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.keyfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.send_service_user_token = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.split_loggers = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.timeout = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:29 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.tls_ciphers = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] service_user.tls_min_version = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.auth_section = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.auth_type = password {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.certfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.collect_timing = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.insecure = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.keyfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.region_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.split_loggers = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.timeout = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.tls_ciphers = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] glance.tls_min_version = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.backend_availability_zone = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.chap_password = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.chap_username = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.disk_geometry = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.driver_client_cert = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.driver_client_cert_key = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.driver_data_namespace = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.driver_use_ssl = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.extra_capabilities = {} {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.filter_function = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.goodness_function = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.iscsi_target_flags = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.iscsi_write_cache = on {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.iser_helper = tgtadm {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.iser_ip_address = 192.168.122.142 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.iser_port = 3260 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_host = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_login = admin {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_mount_options = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_password = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_private_key = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_share_path = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.num_shell_tries = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.quobyte_volume_url = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.replication_device = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.report_discard_supported = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.reserved_percentage = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.target_helper = tgtadm {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.target_ip_address = 192.168.122.142 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.target_port = 3260 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.target_protocol = iscsi {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.trace_flags = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.unique_fqdn_network = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.use_chap_auth = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volume_backend_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volume_clear = zero {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volume_clear_ionice = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volume_clear_size = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_reports.file_event_handler = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_reports.log_dir = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.backend_availability_zone = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.backend_host = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.chap_password = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.chap_username = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.chiscsi_conf = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.disk_geometry = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.driver_client_cert = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.driver_data_namespace = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.driver_use_ssl = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.extra_capabilities = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.filter_function = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.goodness_function = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.iser_helper = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.iser_ip_address = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.iser_port = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.iser_target_prefix = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_host = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_login = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_mount_options = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_password = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_private_key = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_share_path = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_ssh_port = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.num_shell_tries = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.nvmet_port_id = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.replication_device = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.report_discard_supported = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.reserved_percentage = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.scst_target_driver = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.storage_protocol = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.target_helper = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.target_ip_address = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.target_port = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.target_prefix = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.target_protocol = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.trace_flags = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.use_chap_auth = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volume_clear = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volume_clear_size = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] QuobyteHD.volumes_dir = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.ssl = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_notifications.driver = [] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_notifications.retry = -1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] key_manager.fixed_key = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.barbican_api_version = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.barbican_endpoint = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.barbican_endpoint_type = public {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.barbican_region_name = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.cafile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.certfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.collect_timing = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.insecure = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.keyfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.number_of_retries = 60 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.retry_delay = 1 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.send_service_user_token = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.split_loggers = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.timeout = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.tls_ciphers = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.tls_min_version = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.verify_ssl = True {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican.verify_ssl_path = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.auth_section = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.auth_type = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.cafile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.certfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.collect_timing = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.insecure = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.keyfile = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.split_loggers = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.timeout = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.tls_ciphers = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] barbican_service_user.tls_min_version = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.approle_role_id = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.approle_secret_id = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.auth_method = approle {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.auth_path = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.kv_mountpoint = secret {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.kv_path = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.kv_version = 2 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.namespace = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.root_token_id = **** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.ssl_ca_crt_file = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.timeout = 60.0 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.token_file = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.token_role = None {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.use_ssl = False {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 13:45:30 devstack cinder-volume[86963]: DEBUG oslo_service.backend._eventlet.service [None req-2dc9bed1-61ef-4999-b90d-77cd7cc5fa3c None None] ******************************************************************************** {{(pid=86963) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 13:45:30 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.286s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:30 devstack cinder-volume[87262]: INFO cinder.volume.driver [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.volume.driver [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5277214050293, 'free_capacity_gb': 1773.5277214050293, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87262) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_db.sqlalchemy.engines [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87262) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writer thread running {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.db.api [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Building query based on filter {{(pid=87262) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87262) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:30 devstack cinder-volume[87262]: INFO cinder.keymgr.migration [None req-516cda8a-c47f-4800-9d50-f69e49cc55c1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 13:45:30 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:45:30 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:45:30 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.250s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:45:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Driver initialization completed successfully. Sep 08 13:45:30 devstack cinder-volume[87262]: INFO cinder.manager [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Initiating service 3 cleanup Sep 08 13:45:30 devstack cinder-volume[87262]: INFO cinder.manager [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Service 3 cleanup completed. Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.service [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Creating RPC server for service cinder-volume {{(pid=87262) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.service [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87262) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 13:45:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:45:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:45:30 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:45:30 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:45:31 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Sep 08 13:45:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.246s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:45:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ec52fb52-9cdf-440f-98d8-3cd6f29ddbd8 None None] Driver post RPC initialization completed successfully. Sep 08 13:45:39 devstack cinder-volume[86963]: DEBUG dbcounter [-] [86963] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:45:40 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:45:41 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:46:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:46:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 6 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:46:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Flow 'volume_create_manager' (8e240c4f-c766-4f26-a7eb-ba9c06eaef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528ed181-7c90-42c2-89a8-6ef8b74cbfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528ed181-7c90-42c2-89a8-6ef8b74cbfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-565223127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388f9099-104c-4bbb-9d1b-9ed93a032123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03702909983f438f97db822528025793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:46:50Z,use_quota=True,user_id='21b04a0b5762402f9d3b0b5b18719ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b741a0-ea51-4a62-a17c-877a6c5473e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b741a0-ea51-4a62-a17c-877a6c5473e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (131ec9b8-cc20-4421-80c9-b17f8b36f389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (131ec9b8-cc20-4421-80c9-b17f8b36f389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388f9099-104c-4bbb-9d1b-9ed93a032123', 'volume_name': 'volume-388f9099-104c-4bbb-9d1b-9ed93a032123', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dfb892-8995-4273-9439-b4fcd8374848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dfb892-8995-4273-9439-b4fcd8374848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25780ed-599f-4ab2-be97-eb05b4daa400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Volume 388f9099-104c-4bbb-9d1b-9ed93a032123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388f9099-104c-4bbb-9d1b-9ed93a032123', 'volume_size': 1} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-565223127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388f9099-104c-4bbb-9d1b-9ed93a032123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03702909983f438f97db822528025793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:46:50Z,use_quota=True,user_id='21b04a0b5762402f9d3b0b5b18719ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Creating volume 388f9099-104c-4bbb-9d1b-9ed93a032123 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:46:50 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:46:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:46:50 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 1073741824 Sep 08 13:46:50 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:46:52 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Sep 08 13:46:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 1073741824" returned: 0 in 1.848s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:46:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:46:52 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 Sep 08 13:46:52 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:46:53 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Sep 08 13:46:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123" returned: 0 in 0.727s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:46:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] <== create_volume: return (2701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:46:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.708s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:46:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25780ed-599f-4ab2-be97-eb05b4daa400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388f9099-104c-4bbb-9d1b-9ed93a032123', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0946c6c4-9077-4ccf-b3b1-3ff436c00f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:53 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Volume volume-388f9099-104c-4bbb-9d1b-9ed93a032123 (388f9099-104c-4bbb-9d1b-9ed93a032123): created successfully Sep 08 13:46:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0946c6c4-9077-4ccf-b3b1-3ff436c00f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Flow 'volume_create_manager' (8e240c4f-c766-4f26-a7eb-ba9c06eaef59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:46:53 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cf10ad6d-c98f-4a63-a4fd-f32c3442fc65 tempest-DeleteServersTestJSON-1265668896 None] Created volume successfully. Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Flow 'volume_create_manager' (b1e106d5-2aa8-43c0-a61d-3f7120d0d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b17cba1-4a1b-4b89-b2d1-cd7dc95bffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b17cba1-4a1b-4b89-b2d1-cd7dc95bffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1974689838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e697adc-1900-48d9-a4a5-abed7e0708ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bf710fd5bd4c96a1dbc5e851d85054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:46:58Z,use_quota=True,user_id='f535ff16be4946d8a93af82817087ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66d6129-bbe8-4f76-8b45-dc333036c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66d6129-bbe8-4f76-8b45-dc333036c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99d9d55-f301-4dff-9297-b06dca67f892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99d9d55-f301-4dff-9297-b06dca67f892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e697adc-1900-48d9-a4a5-abed7e0708ee', 'volume_name': 'volume-4e697adc-1900-48d9-a4a5-abed7e0708ee', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41330e2b-528e-4dc7-a146-1340836422d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41330e2b-528e-4dc7-a146-1340836422d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1b4b1e-f724-4a39-9f55-65187714a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:58 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Volume 4e697adc-1900-48d9-a4a5-abed7e0708ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e697adc-1900-48d9-a4a5-abed7e0708ee', 'volume_size': 1} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1974689838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e697adc-1900-48d9-a4a5-abed7e0708ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bf710fd5bd4c96a1dbc5e851d85054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:46:58Z,use_quota=True,user_id='f535ff16be4946d8a93af82817087ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Creating volume 4e697adc-1900-48d9-a4a5-abed7e0708ee {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:46:58 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:46:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:46:58 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee 1073741824 Sep 08 13:46:58 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:46:59 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee 1073741824" returned: 0 in 0.882s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:46:59 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee Sep 08 13:46:59 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:46:59 devstack cinder-volume[87262]: WARNING py.warnings [req-9413cfbf-39cb-4654-9e68-02a2c746eed9 req-a237de81-2a09-470c-8ab5-56311f7c62d0 tempest-DeleteServersTestJSON-1265668896 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 08 13:46:59 devstack cinder-volume[87262]: .first() Sep 08 13:46:59 devstack cinder-volume[87262]: Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9413cfbf-39cb-4654-9e68-02a2c746eed9 req-a237de81-2a09-470c-8ab5-56311f7c62d0 tempest-DeleteServersTestJSON-1265668896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:46:59 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee" returned: 0 in 0.425s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9413cfbf-39cb-4654-9e68-02a2c746eed9 req-a237de81-2a09-470c-8ab5-56311f7c62d0 tempest-DeleteServersTestJSON-1265668896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.228s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1b4b1e-f724-4a39-9f55-65187714a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e697adc-1900-48d9-a4a5-abed7e0708ee', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf7c70b-6a3e-4798-abe5-0efa52244831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:46:59 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Volume volume-4e697adc-1900-48d9-a4a5-abed7e0708ee (4e697adc-1900-48d9-a4a5-abed7e0708ee): created successfully Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf7c70b-6a3e-4798-abe5-0efa52244831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Flow 'volume_create_manager' (b1e106d5-2aa8-43c0-a61d-3f7120d0d37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9413cfbf-39cb-4654-9e68-02a2c746eed9 req-a237de81-2a09-470c-8ab5-56311f7c62d0 tempest-DeleteServersTestJSON-1265668896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.168s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:46:59 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-63ad4a82-cabc-4e91-8ea5-6021dcf0f06d tempest-VolumesAdminNegativeTest-1373452559 None] Created volume successfully. Sep 08 13:46:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-9413cfbf-39cb-4654-9e68-02a2c746eed9 req-a237de81-2a09-470c-8ab5-56311f7c62d0 tempest-DeleteServersTestJSON-1265668896 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-388f9099-104c-4bbb-9d1b-9ed93a032123', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0835640-8592-4f3c-930a-f781067430ad', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:47:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-9413cfbf-39cb-4654-9e68-02a2c746eed9 req-a237de81-2a09-470c-8ab5-56311f7c62d0 tempest-DeleteServersTestJSON-1265668896 None] attachment_update completed successfully. Sep 08 13:47:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Acquiring lock "cinder-4e697adc-1900-48d9-a4a5-abed7e0708ee-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:47:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Lock "cinder-4e697adc-1900-48d9-a4a5-abed7e0708ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:47:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Acquiring lock "cinder-quobyte-4e697adc-1900-48d9-a4a5-abed7e0708ee" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:47:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Lock "cinder-quobyte-4e697adc-1900-48d9-a4a5-abed7e0708ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:47:00 devstack cinder-volume[87262]: INFO oslo.privsep.daemon [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpl7jmm5xn/privsep.sock'] Sep 08 13:47:00 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpl7jmm5xn/privsep.sock Sep 08 13:47:00 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 13:47:01 devstack cinder-volume[87262]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 08 13:47:02 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:02 devstack cinder-volume[87262]: INFO oslo.privsep.daemon [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Spawned new privsep daemon via rootwrap Sep 08 13:47:02 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Accepted privsep connection to /tmp/tmpl7jmm5xn/privsep.sock {{(pid=87262) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 08 13:47:02 devstack cinder-volume[87262]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 08 13:47:02 devstack cinder-volume[87262]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 08 13:47:02 devstack cinder-volume[87262]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 08 13:47:02 devstack cinder-volume[87262]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88891 Sep 08 13:47:02 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f61ee1-c600-4b63-9d13-40b122bad9c4]: (2,) {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:47:02 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b451e-3767-4021-910d-d6385127fd31]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:47:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:02 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee Sep 08 13:47:02 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:02 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee" returned: 0 in 0.572s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:02 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee Sep 08 13:47:02 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:03 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:47:03 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:03 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.404s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 8 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:47:03 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4e697adc-1900-48d9-a4a5-abed7e0708ee" returned: 0 in 0.759s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Lock "cinder-quobyte-4e697adc-1900-48d9-a4a5-abed7e0708ee" released by "delete_volume" :: held 3.021s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:47:03 devstack cinder-volume[87262]: WARNING cinder.quota [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:47:03 devstack cinder-volume[87262]: WARNING cinder.quota [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Created reservations ['8a41daf6-cadb-4fe8-9f7f-d073f701bc5f', '0b34239f-0bdd-4361-8b74-e2c346b72bbd', '3a8f9aec-3670-46e3-8632-916d8665cd38', '34f9fee2-9d23-4ce3-8e3d-3b5a2e5f6d5c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:47:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:03 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:47:03 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:04 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.352s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:04 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:47:04 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Deleted volume successfully. Sep 08 13:47:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-997abd4a-742e-47d4-8e2e-7339c1a85834 tempest-VolumesAdminNegativeTest-1373452559 None] Lock "cinder-4e697adc-1900-48d9-a4a5-abed7e0708ee-delete_volume" released by "delete_volume" :: held 3.802s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:47:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-50c24280-efda-4427-84e0-3ced827e95c1 req-af54bdd6-ac95-4ae8-9da2-20851c415bf3 tempest-DeleteServersTestJSON-1265668896 None] Terminate volume connection completed successfully. Sep 08 13:47:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-50c24280-efda-4427-84e0-3ced827e95c1 req-af54bdd6-ac95-4ae8-9da2-20851c415bf3 tempest-DeleteServersTestJSON-1265668896 None] Deleting attachment c0835640-8592-4f3c-930a-f781067430ad. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:47:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Acquiring lock "cinder-388f9099-104c-4bbb-9d1b-9ed93a032123-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:47:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Lock "cinder-388f9099-104c-4bbb-9d1b-9ed93a032123-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:47:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Acquiring lock "cinder-quobyte-388f9099-104c-4bbb-9d1b-9ed93a032123" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:47:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Lock "cinder-quobyte-388f9099-104c-4bbb-9d1b-9ed93a032123" acquired by "delete_volume" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:47:07 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[521bd953-794d-4404-b06c-2ae4aec2265f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:47:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:07 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 Sep 08 13:47:07 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:08 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123" returned: 0 in 0.486s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:08 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123 Sep 08 13:47:08 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:08 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-388f9099-104c-4bbb-9d1b-9ed93a032123" returned: 0 in 0.339s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Lock "cinder-quobyte-388f9099-104c-4bbb-9d1b-9ed93a032123" released by "delete_volume" :: held 0.878s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Created reservations ['fec69c4e-309b-4523-b801-77fd3ec0e8b1', '177daeec-f7d9-4c8e-84d5-2227eee6d307', 'f5c534f0-61cd-4260-9fbe-e08f2d170f2f', 'c6915d1d-37a8-4d12-bebc-32f4888e9c5d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:47:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:08 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:47:08 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:09 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.362s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:09 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:47:09 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Deleted volume successfully. Sep 08 13:47:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e56f583-6bb0-4831-b773-2ebf20ef31c9 tempest-DeleteServersTestJSON-1265668896 None] Lock "cinder-388f9099-104c-4bbb-9d1b-9ed93a032123-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Flow 'volume_create_manager' (d1f72f71-4d10-4bcf-b233-075f461df084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8167c58-719d-4bb3-baf4-fa7495bdcda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8167c58-719d-4bb3-baf4-fa7495bdcda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1843343508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32aad5c179634748a8fcbbc539ede271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:47:10Z,use_quota=True,user_id='22e6b5fae9774f84b3e3d8784bbd135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d32716e-4961-4ebe-8cbc-bfdbd935cfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d32716e-4961-4ebe-8cbc-bfdbd935cfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f5b278-c728-4dce-a9c7-d9181bd04674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f5b278-c728-4dce-a9c7-d9181bd04674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0', 'volume_name': 'volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7f8e42-6460-46f7-8f40-0f1eb85a0915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7f8e42-6460-46f7-8f40-0f1eb85a0915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19903760-9076-4b15-8e3f-5881a89b66db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:47:10 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Volume 2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0', 'volume_size': 1} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1843343508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32aad5c179634748a8fcbbc539ede271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:47:10Z,use_quota=True,user_id='22e6b5fae9774f84b3e3d8784bbd135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Creating volume 2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:47:10 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:10 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 1073741824 Sep 08 13:47:10 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:10 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 1073741824" returned: 0 in 0.534s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:47:10 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 Sep 08 13:47:10 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:47:11 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Sep 08 13:47:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0" returned: 0 in 0.283s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:47:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:47:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:47:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19903760-9076-4b15-8e3f-5881a89b66db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:47:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8e29ed-c703-42ae-9b90-236261b05838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:47:11 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Volume volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 (2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0): created successfully Sep 08 13:47:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8e29ed-c703-42ae-9b90-236261b05838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:47:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Flow 'volume_create_manager' (d1f72f71-4d10-4bcf-b233-075f461df084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:47:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1193f657-c094-4127-8190-24dfc8935982 tempest-AttachVolumeNegativeTest-1455610819 None] Created volume successfully. Sep 08 13:47:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-317a82a3-2f5a-4c98-b88f-22da38a8464f req-43d0f4c3-6a89-466d-8a62-031505ccc57e tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:47:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-317a82a3-2f5a-4c98-b88f-22da38a8464f req-43d0f4c3-6a89-466d-8a62-031505ccc57e tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:47:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-317a82a3-2f5a-4c98-b88f-22da38a8464f req-43d0f4c3-6a89-466d-8a62-031505ccc57e tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:47:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-317a82a3-2f5a-4c98-b88f-22da38a8464f req-43d0f4c3-6a89-466d-8a62-031505ccc57e tempest-AttachVolumeNegativeTest-1455610819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3bdaf96-2b7c-4a92-a629-9ea4d18924e1', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:47:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-317a82a3-2f5a-4c98-b88f-22da38a8464f req-43d0f4c3-6a89-466d-8a62-031505ccc57e tempest-AttachVolumeNegativeTest-1455610819 None] attachment_update completed successfully. Sep 08 13:47:23 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=28,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:47:23 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=33,cinder:SELECT=32,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:47:41 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Flow 'volume_create_manager' (5fa8be3c-8910-4c70-987e-fcf40cb4e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bf4ff0-7484-4e2a-844e-a38083bde9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bf4ff0-7484-4e2a-844e-a38083bde9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-394801869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869410f7-6b21-461b-a3dc-9f6b8c8d8b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98bce052a05433186a4466f803b53b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:48:01Z,use_quota=True,user_id='d89b3e20bfa840d699b2e3c9e231b2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74b85ef-c1f5-4a81-93ea-b9edcefc278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74b85ef-c1f5-4a81-93ea-b9edcefc278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca6f6c6-5132-4b4e-954f-23823b524faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca6f6c6-5132-4b4e-954f-23823b524faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869410f7-6b21-461b-a3dc-9f6b8c8d8b4e', 'volume_name': 'volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255e2f45-2ca9-4726-9591-09fccc6493c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255e2f45-2ca9-4726-9591-09fccc6493c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e5cc7-3488-4af0-9afb-5fc267db986b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:01 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Volume 869410f7-6b21-461b-a3dc-9f6b8c8d8b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e', 'volume_size': 1} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-394801869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869410f7-6b21-461b-a3dc-9f6b8c8d8b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98bce052a05433186a4466f803b53b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:48:01Z,use_quota=True,user_id='d89b3e20bfa840d699b2e3c9e231b2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Creating volume 869410f7-6b21-461b-a3dc-9f6b8c8d8b4e {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:48:01 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:48:01 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e 1073741824 Sep 08 13:48:01 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:48:01 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e 1073741824" returned: 0 in 0.590s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:48:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:48:01 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e Sep 08 13:48:01 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:48:02 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Sep 08 13:48:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:48:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:48:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e5cc7-3488-4af0-9afb-5fc267db986b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2bd077-02b0-48ad-b2d1-57cea9360fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:02 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Volume volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e (869410f7-6b21-461b-a3dc-9f6b8c8d8b4e): created successfully Sep 08 13:48:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2bd077-02b0-48ad-b2d1-57cea9360fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Flow 'volume_create_manager' (5fa8be3c-8910-4c70-987e-fcf40cb4e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:48:02 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-01b68c86-ef35-44f0-8f91-af28272d994c tempest-TaggedAttachmentsTest-818806507 None] Created volume successfully. Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:48:03 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:48:03 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:48:03 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.294s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:48:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Flow 'volume_create_manager' (d6c02a9b-529e-40e7-8653-3db76fe0b382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b01c8a-37c6-4ced-a8f6-8e86060e341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b01c8a-37c6-4ced-a8f6-8e86060e341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-514253403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47a0de8-71d1-41c1-95c3-8eba6be112ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de0ba89b6c342f69c885c558d9aaa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:48:10Z,use_quota=True,user_id='40ae0a47cb304011bd10d2ecafb255f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9940abd6-5456-4867-98d4-27f1c24f0f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9940abd6-5456-4867-98d4-27f1c24f0f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadade93-57e9-4332-8abb-a0d1106b1257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadade93-57e9-4332-8abb-a0d1106b1257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47a0de8-71d1-41c1-95c3-8eba6be112ed', 'volume_name': 'volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbc7377-156d-4121-9fa6-2423f91252eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbc7377-156d-4121-9fa6-2423f91252eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565654eb-d5e3-4bfa-9ea0-abb2847f0ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:10 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Volume c47a0de8-71d1-41c1-95c3-8eba6be112ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed', 'volume_size': 1} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-514253403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47a0de8-71d1-41c1-95c3-8eba6be112ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de0ba89b6c342f69c885c558d9aaa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:48:10Z,use_quota=True,user_id='40ae0a47cb304011bd10d2ecafb255f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Creating volume c47a0de8-71d1-41c1-95c3-8eba6be112ed {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:48:10 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:48:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:48:10 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed 1073741824 Sep 08 13:48:10 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:48:11 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed 1073741824" returned: 0 in 0.677s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:48:11 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed Sep 08 13:48:11 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:48:11 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed" returned: 0 in 0.434s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565654eb-d5e3-4bfa-9ea0-abb2847f0ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ba3ada-6f0d-460c-a5c5-593db37c64ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:11 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Volume volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed (c47a0de8-71d1-41c1-95c3-8eba6be112ed): created successfully Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ba3ada-6f0d-460c-a5c5-593db37c64ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Flow 'volume_create_manager' (d6c02a9b-529e-40e7-8653-3db76fe0b382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:48:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-efb34809-4962-444e-9163-3b84a86760ae tempest-ServerActionsTestOtherA-1703642632 None] Created volume successfully. Sep 08 13:48:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-7baf3e82-e8ae-4d3f-a5d6-4889e3398588 req-e8994449-edfc-4cc4-b543-0913bb044c23 tempest-AttachVolumeNegativeTest-1455610819 None] Terminate volume connection completed successfully. Sep 08 13:48:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-7baf3e82-e8ae-4d3f-a5d6-4889e3398588 req-e8994449-edfc-4cc4-b543-0913bb044c23 tempest-AttachVolumeNegativeTest-1455610819 None] Deleting attachment f3bdaf96-2b7c-4a92-a629-9ea4d18924e1. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:48:21 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:48:25 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Flow 'volume_create_manager' (c9d880d5-c651-4663-b5d0-71c24682dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c53b592-8d19-455e-8bba-669e097db64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c53b592-8d19-455e-8bba-669e097db64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-158665756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0556513f-1687-4caa-83cb-3a6ae5348fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7ce48126014ef1aca8dd52068080c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:48:40Z,use_quota=True,user_id='0750f7adeeb1424b88c283f8ffb6cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87eaa2c6-be0e-432b-8754-ed913f11acce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87eaa2c6-be0e-432b-8754-ed913f11acce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd437944-157e-4262-af66-3f4108f747fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd437944-157e-4262-af66-3f4108f747fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0556513f-1687-4caa-83cb-3a6ae5348fbc', 'volume_name': 'volume-0556513f-1687-4caa-83cb-3a6ae5348fbc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef70fe61-9551-4ac7-8fc4-ff1d13a309cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef70fe61-9551-4ac7-8fc4-ff1d13a309cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4993896e-db09-4c1e-8723-6c1b736e06d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:40 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Volume 0556513f-1687-4caa-83cb-3a6ae5348fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0556513f-1687-4caa-83cb-3a6ae5348fbc', 'volume_size': 1} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-158665756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0556513f-1687-4caa-83cb-3a6ae5348fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7ce48126014ef1aca8dd52068080c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:48:40Z,use_quota=True,user_id='0750f7adeeb1424b88c283f8ffb6cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Creating volume 0556513f-1687-4caa-83cb-3a6ae5348fbc {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:48:40 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:48:40 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc 1073741824 Sep 08 13:48:40 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:48:40 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc 1073741824" returned: 0 in 0.706s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:48:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:48:40 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc Sep 08 13:48:40 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:48:41 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Sep 08 13:48:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc" returned: 0 in 0.304s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:48:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:48:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4993896e-db09-4c1e-8723-6c1b736e06d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0556513f-1687-4caa-83cb-3a6ae5348fbc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e557ee97-d24b-418c-aac0-c429fec347bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:48:41 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Volume volume-0556513f-1687-4caa-83cb-3a6ae5348fbc (0556513f-1687-4caa-83cb-3a6ae5348fbc): created successfully Sep 08 13:48:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e557ee97-d24b-418c-aac0-c429fec347bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:48:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Flow 'volume_create_manager' (c9d880d5-c651-4663-b5d0-71c24682dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:48:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fdcc52ea-1a63-4166-81c3-315a263a5db5 tempest-AttachVolumeTestJSON-104748426 None] Created volume successfully. Sep 08 13:48:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-3853b216-1c91-4580-8caa-a59f4beaaa46 req-374e8516-f57c-47df-be9f-c663cc81d82f tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-3853b216-1c91-4580-8caa-a59f4beaaa46 req-374e8516-f57c-47df-be9f-c663cc81d82f tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-3853b216-1c91-4580-8caa-a59f4beaaa46 req-374e8516-f57c-47df-be9f-c663cc81d82f tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-3853b216-1c91-4580-8caa-a59f4beaaa46 req-374e8516-f57c-47df-be9f-c663cc81d82f tempest-AttachVolumeTestJSON-104748426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-0556513f-1687-4caa-83cb-3a6ae5348fbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccd255c3-e9cc-4096-a1e8-e4dfd2045969', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:48:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-3853b216-1c91-4580-8caa-a59f4beaaa46 req-374e8516-f57c-47df-be9f-c663cc81d82f tempest-AttachVolumeTestJSON-104748426 None] attachment_update completed successfully. Sep 08 13:48:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-4d79b449-000d-46c8-956c-63d45699af84 req-3a895611-e77f-4bfa-adc4-d32be0d18683 tempest-TaggedAttachmentsTest-818806507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-4d79b449-000d-46c8-956c-63d45699af84 req-3a895611-e77f-4bfa-adc4-d32be0d18683 tempest-TaggedAttachmentsTest-818806507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-4d79b449-000d-46c8-956c-63d45699af84 req-3a895611-e77f-4bfa-adc4-d32be0d18683 tempest-TaggedAttachmentsTest-818806507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-4d79b449-000d-46c8-956c-63d45699af84 req-3a895611-e77f-4bfa-adc4-d32be0d18683 tempest-TaggedAttachmentsTest-818806507 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43639495-0cde-4826-8a4d-1c089107698b', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:48:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-4d79b449-000d-46c8-956c-63d45699af84 req-3a895611-e77f-4bfa-adc4-d32be0d18683 tempest-TaggedAttachmentsTest-818806507 None] attachment_update completed successfully. Sep 08 13:48:56 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-48355212-b0de-4bb4-a379-79949cf596a4 req-d67fa1f8-0a38-44af-a5b5-e7d3a190d0c2 tempest-TaggedAttachmentsTest-818806507 None] Terminate volume connection completed successfully. Sep 08 13:48:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-48355212-b0de-4bb4-a379-79949cf596a4 req-d67fa1f8-0a38-44af-a5b5-e7d3a190d0c2 tempest-TaggedAttachmentsTest-818806507 None] Deleting attachment 43639495-0cde-4826-8a4d-1c089107698b. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:48:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-1ff0d941-2263-4faf-a166-cc393469438a req-1815174d-2a48-4f3d-afec-960040792dfd tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:48:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-1ff0d941-2263-4faf-a166-cc393469438a req-1815174d-2a48-4f3d-afec-960040792dfd tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:48:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-1ff0d941-2263-4faf-a166-cc393469438a req-1815174d-2a48-4f3d-afec-960040792dfd tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:48:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-1ff0d941-2263-4faf-a166-cc393469438a req-1815174d-2a48-4f3d-afec-960040792dfd tempest-ServerActionsTestOtherA-1703642632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4384eddf-ef52-49a9-82b0-60b13d56b00a', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:48:58 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-1ff0d941-2263-4faf-a166-cc393469438a req-1815174d-2a48-4f3d-afec-960040792dfd tempest-ServerActionsTestOtherA-1703642632 None] attachment_update completed successfully. Sep 08 13:49:02 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-ce6dc50a-7cc4-4031-a89f-67a3be4729b1 req-6072a319-f25c-49c4-9bc4-090d80646c0e tempest-ServerActionsTestOtherA-1703642632 None] Terminate volume connection completed successfully. Sep 08 13:49:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ce6dc50a-7cc4-4031-a89f-67a3be4729b1 req-6072a319-f25c-49c4-9bc4-090d80646c0e tempest-ServerActionsTestOtherA-1703642632 None] Deleting attachment 4384eddf-ef52-49a9-82b0-60b13d56b00a. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:03 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:49:03 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:03 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.628s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 8 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:49:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:49:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ce6dc50a-7cc4-4031-a89f-67a3be4729b1 req-868b786a-97dc-4e72-8d7e-c8fc7b7ff8c9 tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ce6dc50a-7cc4-4031-a89f-67a3be4729b1 req-868b786a-97dc-4e72-8d7e-c8fc7b7ff8c9 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ce6dc50a-7cc4-4031-a89f-67a3be4729b1 req-868b786a-97dc-4e72-8d7e-c8fc7b7ff8c9 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ce6dc50a-7cc4-4031-a89f-67a3be4729b1 req-868b786a-97dc-4e72-8d7e-c8fc7b7ff8c9 tempest-ServerActionsTestOtherA-1703642632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50033309-9151-40e4-94bc-836fadee30d2', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:49:04 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-ce6dc50a-7cc4-4031-a89f-67a3be4729b1 req-868b786a-97dc-4e72-8d7e-c8fc7b7ff8c9 tempest-ServerActionsTestOtherA-1703642632 None] attachment_update completed successfully. Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Flow 'volume_create_manager' (74118601-38f0-49a2-9b93-1047168e00b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32385bb2-36bb-4363-a33e-446a57df2725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32385bb2-36bb-4363-a33e-446a57df2725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-800940901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6d9dce-3ba3-4184-920b-248526b6c965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32aad5c179634748a8fcbbc539ede271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:49:07Z,use_quota=True,user_id='22e6b5fae9774f84b3e3d8784bbd135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28a4cef-17e1-4d8c-9675-38c065aa095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28a4cef-17e1-4d8c-9675-38c065aa095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c65c643-197c-498f-a372-254b9ee7e7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c65c643-197c-498f-a372-254b9ee7e7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6d9dce-3ba3-4184-920b-248526b6c965', 'volume_name': 'volume-4a6d9dce-3ba3-4184-920b-248526b6c965', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ab519a-d852-4b93-a861-56737a55f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ab519a-d852-4b93-a861-56737a55f021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d64991f-a9c8-446f-9ca3-273f39016aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:07 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Volume 4a6d9dce-3ba3-4184-920b-248526b6c965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6d9dce-3ba3-4184-920b-248526b6c965', 'volume_size': 1} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-800940901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6d9dce-3ba3-4184-920b-248526b6c965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32aad5c179634748a8fcbbc539ede271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:49:07Z,use_quota=True,user_id='22e6b5fae9774f84b3e3d8784bbd135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Creating volume 4a6d9dce-3ba3-4184-920b-248526b6c965 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:49:07 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:49:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:07 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 1073741824 Sep 08 13:49:07 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:08 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 1073741824" returned: 0 in 0.871s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:08 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 Sep 08 13:49:08 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:08 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965" returned: 0 in 0.404s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:49:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d64991f-a9c8-446f-9ca3-273f39016aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6d9dce-3ba3-4184-920b-248526b6c965', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0683dc-7cf1-43d2-a16a-a1f9406b7a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:08 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Volume volume-4a6d9dce-3ba3-4184-920b-248526b6c965 (4a6d9dce-3ba3-4184-920b-248526b6c965): created successfully Sep 08 13:49:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0683dc-7cf1-43d2-a16a-a1f9406b7a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Flow 'volume_create_manager' (74118601-38f0-49a2-9b93-1047168e00b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:49:09 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-887868d1-cf4a-4aef-ad11-e4358e10700e tempest-AttachVolumeNegativeTest-1455610819 None] Created volume successfully. Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9d75a805-d913-4d2e-ba1c-686aec9a15a2 req-84733e52-ab8e-4e10-9f96-4e13b67e8c27 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9d75a805-d913-4d2e-ba1c-686aec9a15a2 req-84733e52-ab8e-4e10-9f96-4e13b67e8c27 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9d75a805-d913-4d2e-ba1c-686aec9a15a2 req-84733e52-ab8e-4e10-9f96-4e13b67e8c27 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-9d75a805-d913-4d2e-ba1c-686aec9a15a2 req-84733e52-ab8e-4e10-9f96-4e13b67e8c27 tempest-AttachVolumeNegativeTest-1455610819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-4a6d9dce-3ba3-4184-920b-248526b6c965', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85c84f97-1520-464c-8dea-cb660c93f6c0', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:49:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-9d75a805-d913-4d2e-ba1c-686aec9a15a2 req-84733e52-ab8e-4e10-9f96-4e13b67e8c27 tempest-AttachVolumeNegativeTest-1455610819 None] attachment_update completed successfully. Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Acquiring lock "cinder-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Lock "cinder-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Acquiring lock "cinder-quobyte-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Lock "cinder-quobyte-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e" acquired by "delete_volume" :: waited 0.047s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[837858bc-fb97-4b01-9539-c5bb1d7b1086]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:49:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:11 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e Sep 08 13:49:11 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:12 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e" returned: 0 in 0.478s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:12 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e Sep 08 13:49:12 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:12 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e" returned: 0 in 0.272s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Lock "cinder-quobyte-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e" released by "delete_volume" :: held 0.813s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Created reservations ['418aeed6-707a-4014-8fe2-a87b69ded99f', 'a5d8f8c4-c6d4-4cbe-9e13-8e79b6c3e7bb', '4684a971-97ac-40ff-afe0-3fd4d251b786', 'ea4f3f82-a55b-409d-9d41-586df688979b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:12 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:49:12 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:13 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.451s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:13 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:49:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Deleted volume successfully. Sep 08 13:49:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d36d77e7-e9bd-4082-8b1e-af01c412c60c tempest-TaggedAttachmentsTest-818806507 None] Lock "cinder-869410f7-6b21-461b-a3dc-9f6b8c8d8b4e-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:49:14 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-2be350c9-74ea-4857-b1d7-4585b78e692b req-455fc950-5a25-4dea-b3ee-b4266d9b3c91 tempest-AttachVolumeNegativeTest-1455610819 None] Terminate volume connection completed successfully. Sep 08 13:49:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-2be350c9-74ea-4857-b1d7-4585b78e692b req-455fc950-5a25-4dea-b3ee-b4266d9b3c91 tempest-AttachVolumeNegativeTest-1455610819 None] Deleting attachment 85c84f97-1520-464c-8dea-cb660c93f6c0. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:49:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-c98e57e0-8a66-4453-bb74-94cf5448228c req-8b08872f-7859-4833-88bb-05b1da4a77c1 tempest-AttachVolumeTestJSON-104748426 None] Terminate volume connection completed successfully. Sep 08 13:49:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-c98e57e0-8a66-4453-bb74-94cf5448228c req-8b08872f-7859-4833-88bb-05b1da4a77c1 tempest-AttachVolumeTestJSON-104748426 None] Deleting attachment ccd255c3-e9cc-4096-a1e8-e4dfd2045969. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:49:24 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=45,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:49:25 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=25,cinder:SELECT=46,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:49:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-ef1942d9-0fd5-414d-add2-27d768e79ee8 req-dd3852f5-e3a1-4252-93b7-2402f62a518b tempest-ServerActionsTestOtherA-1703642632 None] Terminate volume connection completed successfully. Sep 08 13:49:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ef1942d9-0fd5-414d-add2-27d768e79ee8 req-dd3852f5-e3a1-4252-93b7-2402f62a518b tempest-ServerActionsTestOtherA-1703642632 None] Deleting attachment 50033309-9151-40e4-94bc-836fadee30d2. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:49:43 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:49:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Flow 'volume_create_manager' (98149bbb-55df-4f17-9a4d-80f7e2cd7da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:49:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d8e2fe-53fe-4ced-8dcd-f2fc322de2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d8e2fe-53fe-4ced-8dcd-f2fc322de2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-736057720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d145e81-5d9d-4022-86eb-c93def49013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de0ba89b6c342f69c885c558d9aaa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:49:44Z,use_quota=True,user_id='40ae0a47cb304011bd10d2ecafb255f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cad6ba-f802-4633-8fd9-eb4fbfe880b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cad6ba-f802-4633-8fd9-eb4fbfe880b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa3abb9-3109-457c-b77f-2f16440ddca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:43 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 13:49:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa3abb9-3109-457c-b77f-2f16440ddca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d145e81-5d9d-4022-86eb-c93def49013a', 'volume_name': 'volume-1d145e81-5d9d-4022-86eb-c93def49013a', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dcb1d2e-73ae-4120-8922-3896c9c03044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dcb1d2e-73ae-4120-8922-3896c9c03044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0aa6fb-1620-40e3-8536-d6719583e731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:44 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Volume 1d145e81-5d9d-4022-86eb-c93def49013a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d145e81-5d9d-4022-86eb-c93def49013a', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 13:49:44 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Trying to clone 1d145e81-5d9d-4022-86eb-c93def49013a from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f at location (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 13:49:44 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 13:49:44 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Image download 20.69 MB at 20.69 MB/s Sep 08 13:49:44 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3485688-ad91-4a95-93f4-a82ae69e5291]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:49:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:45 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD Sep 08 13:49:45 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:45 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f is fetched for user 40ae0a47cb304011bd10d2ecafb255f5. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279b2a1-5cee-485c-873a-e5cbc5368e9c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:45 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD Sep 08 13:49:45 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:45 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-736057720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d145e81-5d9d-4022-86eb-c93def49013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de0ba89b6c342f69c885c558d9aaa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:49:44Z,use_quota=True,user_id='40ae0a47cb304011bd10d2ecafb255f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Creating volume 1d145e81-5d9d-4022-86eb-c93def49013a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:49:45 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:49:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:46 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a 1073741824 Sep 08 13:49:46 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:46 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a 1073741824" returned: 0 in 0.559s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:46 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a Sep 08 13:49:46 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:46 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a" returned: 0 in 0.347s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:49:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:46 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Attempting download of 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume 1d145e81-5d9d-4022-86eb-c93def49013a. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 13:49:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[893df983-b617-497c-b060-e2237987a932]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:49:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_f1uxuv6u {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:47 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_f1uxuv6u Sep 08 13:49:47 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:47 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_f1uxuv6u" returned: 0 in 0.477s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_f1uxuv6u {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:47 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_f1uxuv6u Sep 08 13:49:47 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:48 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_f1uxuv6u" returned: 1 in 0.650s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_f1uxuv6u' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:49:48 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c37a29-4694-4999-9c00-8eb2c89cbd58]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:49:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:48 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD Sep 08 13:49:48 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:48 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:48 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f was qcow2, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 13:49:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:48 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a Sep 08 13:49:48 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:51 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a" returned: 0 in 2.600s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_vp2jxzwodevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:49:51 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Converted 112.00 MB image at 43.06 MB/s Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:51 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a 1G Sep 08 13:49:51 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:51 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a 1G" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Downloaded image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume 1d145e81-5d9d-4022-86eb-c93def49013a successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f for user 40ae0a47cb304011bd10d2ecafb255f5 is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Marking volume 1d145e81-5d9d-4022-86eb-c93def49013a as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Copying metadata from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f to 1d145e81-5d9d-4022-86eb-c93def49013a. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Creating volume glance metadata for volume 1d145e81-5d9d-4022-86eb-c93def49013a backed by image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0aa6fb-1620-40e3-8536-d6719583e731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d145e81-5d9d-4022-86eb-c93def49013a', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b25f645-15ff-4ceb-970b-ad6d6e46d121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:51 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Volume volume-1d145e81-5d9d-4022-86eb-c93def49013a (1d145e81-5d9d-4022-86eb-c93def49013a): created successfully Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b25f645-15ff-4ceb-970b-ad6d6e46d121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Flow 'volume_create_manager' (98149bbb-55df-4f17-9a4d-80f7e2cd7da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:49:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1336f07e-2218-4f52-a8ae-8e90be6b3eb9 tempest-ServerActionsTestOtherA-1703642632 None] Created volume successfully. Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Flow 'volume_create_manager' (52a72e61-e14e-47f1-8fbf-6b1f54e7377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb35cac8-9b63-47bc-b27f-9cf0738975a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb35cac8-9b63-47bc-b27f-9cf0738975a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-743999959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2718475-7ec8-48a0-bb1b-11e2cb46a93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32aad5c179634748a8fcbbc539ede271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:49:59Z,use_quota=True,user_id='22e6b5fae9774f84b3e3d8784bbd135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf8e550-6b13-403e-ad05-8807bb444af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf8e550-6b13-403e-ad05-8807bb444af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15fe6538-c8b8-4b32-9d23-dfc39263b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15fe6538-c8b8-4b32-9d23-dfc39263b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2718475-7ec8-48a0-bb1b-11e2cb46a93f', 'volume_name': 'volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a4e378-a527-4789-8a90-74c279be6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a4e378-a527-4789-8a90-74c279be6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7184a3af-e69f-4882-89a5-12cdfb12bc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:49:59 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Volume b2718475-7ec8-48a0-bb1b-11e2cb46a93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f', 'volume_size': 1} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-743999959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2718475-7ec8-48a0-bb1b-11e2cb46a93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32aad5c179634748a8fcbbc539ede271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:49:59Z,use_quota=True,user_id='22e6b5fae9774f84b3e3d8784bbd135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Creating volume b2718475-7ec8-48a0-bb1b-11e2cb46a93f {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:49:59 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:49:59 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f 1073741824 Sep 08 13:49:59 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:49:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9dc1e51a-69f6-4b57-aac5-186b3f475a53 req-bda68cc8-cbf2-4778-9705-e3ced9c74c15 tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:00 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f 1073741824" returned: 0 in 0.868s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:00 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f Sep 08 13:50:00 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:01 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f" returned: 0 in 0.690s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9dc1e51a-69f6-4b57-aac5-186b3f475a53 req-bda68cc8-cbf2-4778-9705-e3ced9c74c15 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.465s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7184a3af-e69f-4882-89a5-12cdfb12bc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7bb28a-3186-467a-ba2c-590ffa60f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-9dc1e51a-69f6-4b57-aac5-186b3f475a53 req-bda68cc8-cbf2-4778-9705-e3ced9c74c15 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.135s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:01 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Volume volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f (b2718475-7ec8-48a0-bb1b-11e2cb46a93f): created successfully Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7bb28a-3186-467a-ba2c-590ffa60f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Flow 'volume_create_manager' (52a72e61-e14e-47f1-8fbf-6b1f54e7377c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-10afc289-4a5d-45c0-88e1-a9e61fffbb7b tempest-AttachVolumeNegativeTest-1455610819 None] Created volume successfully. Sep 08 13:50:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-9dc1e51a-69f6-4b57-aac5-186b3f475a53 req-bda68cc8-cbf2-4778-9705-e3ced9c74c15 tempest-ServerActionsTestOtherA-1703642632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-1d145e81-5d9d-4022-86eb-c93def49013a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4f1a43a-ade4-46d1-b112-64a513efce6d', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:50:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-9dc1e51a-69f6-4b57-aac5-186b3f475a53 req-bda68cc8-cbf2-4778-9705-e3ced9c74c15 tempest-ServerActionsTestOtherA-1703642632 None] attachment_update completed successfully. Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:03 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:50:03 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:03 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.638s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 28 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:50:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:50:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-d5e2a105-3732-4e2e-ad1f-abaf88f10563 req-68e46aa2-d356-48db-8306-28eecdd638ba tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-d5e2a105-3732-4e2e-ad1f-abaf88f10563 req-68e46aa2-d356-48db-8306-28eecdd638ba tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-d5e2a105-3732-4e2e-ad1f-abaf88f10563 req-68e46aa2-d356-48db-8306-28eecdd638ba tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-d5e2a105-3732-4e2e-ad1f-abaf88f10563 req-68e46aa2-d356-48db-8306-28eecdd638ba tempest-AttachVolumeNegativeTest-1455610819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4eac114-4da4-4b7e-82f0-89357efc294d', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:50:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-d5e2a105-3732-4e2e-ad1f-abaf88f10563 req-68e46aa2-d356-48db-8306-28eecdd638ba tempest-AttachVolumeNegativeTest-1455610819 None] attachment_update completed successfully. Sep 08 13:50:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-8b971b98-843b-4652-bd0d-9436c650f8b7 req-ae8675fd-eb83-45c1-ac3e-af2e57add65c tempest-AttachVolumeNegativeTest-1455610819 None] Terminate volume connection completed successfully. Sep 08 13:50:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-8b971b98-843b-4652-bd0d-9436c650f8b7 req-ae8675fd-eb83-45c1-ac3e-af2e57add65c tempest-AttachVolumeNegativeTest-1455610819 None] Deleting attachment a4eac114-4da4-4b7e-82f0-89357efc294d. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:50:21 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=23,cinder:UPDATE=15,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:50:21 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=7,cinder:SELECT=31,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:50:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "cinder-b2718475-7ec8-48a0-bb1b-11e2cb46a93f-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-b2718475-7ec8-48a0-bb1b-11e2cb46a93f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "cinder-quobyte-b2718475-7ec8-48a0-bb1b-11e2cb46a93f" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-quobyte-b2718475-7ec8-48a0-bb1b-11e2cb46a93f" acquired by "delete_volume" :: waited 0.045s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478c0a4-bc45-4c77-87ef-9f8b396feb6f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:26 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f Sep 08 13:50:26 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:27 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f" returned: 0 in 0.639s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:27 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f Sep 08 13:50:27 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:27 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b2718475-7ec8-48a0-bb1b-11e2cb46a93f" returned: 0 in 0.473s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-quobyte-b2718475-7ec8-48a0-bb1b-11e2cb46a93f" released by "delete_volume" :: held 1.248s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:27 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Created reservations ['463f7927-b80c-4912-9ca2-9a1360022284', 'aeb72c42-40c1-4949-9b47-996596940f67', 'e0746fde-9cd5-4d06-89b8-5cf880c2d477', 'fbf706ef-5c3d-4474-94ec-ef8a832096ba'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:28 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:50:28 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:28 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.520s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:50:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Deleted volume successfully. Sep 08 13:50:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfaa62a6-c5b9-4ff4-ba55-9a5081c4be68 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-b2718475-7ec8-48a0-bb1b-11e2cb46a93f-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "cinder-4a6d9dce-3ba3-4184-920b-248526b6c965-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-4a6d9dce-3ba3-4184-920b-248526b6c965-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "cinder-quobyte-4a6d9dce-3ba3-4184-920b-248526b6c965" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-quobyte-4a6d9dce-3ba3-4184-920b-248526b6c965" acquired by "delete_volume" :: waited 0.065s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f57e3b2-25d9-42bb-8259-da3bed72f077]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:29 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 Sep 08 13:50:29 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Flow 'volume_create_manager' (f6397271-902f-49dd-b5b4-aec4f22fc07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2f1a67-547d-49cd-8ac4-740819eefaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2f1a67-547d-49cd-8ac4-740819eefaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-386326453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143edcb3-5578-4b97-9dec-cc6a8ee3a3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003fa7894076458e8fc3f3ac32fe9d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:30Z,use_quota=True,user_id='1ad1a1e8221d4f4684fcb26c47c5bc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4f4f2e-fe52-4c1b-beff-9f1fbc54dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4f4f2e-fe52-4c1b-beff-9f1fbc54dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427684ea-7662-4870-8a75-0a3864d536d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427684ea-7662-4870-8a75-0a3864d536d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143edcb3-5578-4b97-9dec-cc6a8ee3a3de', 'volume_name': 'volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f39c69-b236-4998-bbe5-0a6d6bf55430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f39c69-b236-4998-bbe5-0a6d6bf55430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a148c960-bd24-413b-9a8c-3ee1f0357bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:29 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Volume 143edcb3-5578-4b97-9dec-cc6a8ee3a3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de', 'volume_size': 1} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-386326453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143edcb3-5578-4b97-9dec-cc6a8ee3a3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003fa7894076458e8fc3f3ac32fe9d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:30Z,use_quota=True,user_id='1ad1a1e8221d4f4684fcb26c47c5bc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Creating volume 143edcb3-5578-4b97-9dec-cc6a8ee3a3de {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:50:29 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:50:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:29 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de 1073741824 Sep 08 13:50:29 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:30 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965" returned: 0 in 0.760s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:30 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965 Sep 08 13:50:30 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:30 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4a6d9dce-3ba3-4184-920b-248526b6c965" returned: 0 in 0.498s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-quobyte-4a6d9dce-3ba3-4184-920b-248526b6c965" released by "delete_volume" :: held 1.342s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Created reservations ['c092942c-21c2-41d2-9aad-6d922bdfee72', '29a7b56b-cddf-4e01-baaa-68dec91c69ec', '3596112b-28ed-43d0-9f96-52f1eb4dc092', 'd718ee30-cd0f-47a3-a096-91927372a10a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:50:30 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de 1073741824" returned: 0 in 1.025s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:30 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de Sep 08 13:50:30 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:31 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:50:31 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:31 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de" returned: 0 in 0.340s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a148c960-bd24-413b-9a8c-3ee1f0357bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbce69f-681d-4bef-a5a9-fb7ae092462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:31 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:31 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Volume volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de (143edcb3-5578-4b97-9dec-cc6a8ee3a3de): created successfully Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbce69f-681d-4bef-a5a9-fb7ae092462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Flow 'volume_create_manager' (f6397271-902f-49dd-b5b4-aec4f22fc07f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.341s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:50:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Deleted volume successfully. Sep 08 13:50:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5781477a-f19d-4a54-a3c3-9b3f594d224e tempest-ServersNegativeTestJSON-235222217 None] Created volume successfully. Sep 08 13:50:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cae82b72-29c0-4162-8288-d59df2d3b581 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-4a6d9dce-3ba3-4184-920b-248526b6c965-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "cinder-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "cinder-quobyte-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-quobyte-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0" acquired by "delete_volume" :: waited 0.037s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:32 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-6ae3cbdf-e23e-42a8-befd-75de61591103 req-cd0a73a3-3f52-41a7-b00a-2ea410ae1169 tempest-ServerActionsTestOtherA-1703642632 None] Terminate volume connection completed successfully. Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-6ae3cbdf-e23e-42a8-befd-75de61591103 req-cd0a73a3-3f52-41a7-b00a-2ea410ae1169 tempest-ServerActionsTestOtherA-1703642632 None] Deleting attachment b4f1a43a-ade4-46d1-b112-64a513efce6d. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[697f76ee-51c3-4fdb-820b-cf788b93b201]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:32 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 Sep 08 13:50:32 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:32 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0" returned: 0 in 0.501s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:32 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0 Sep 08 13:50:32 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:33 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0" returned: 0 in 0.350s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-quobyte-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0" released by "delete_volume" :: held 0.957s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Created reservations ['65e94c2e-20c1-42a9-a2e8-03243699fa80', '228fb9b7-4113-41a9-a1ba-ae1ce77c1a57', '65733931-2a61-4cac-8337-44b224cb9127', 'd28e23b3-1d1d-4285-a913-de052e547908'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:33 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:50:33 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:50:33 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Flow 'volume_create_manager' (c62ff5e4-8bd0-4e64-b75e-329cdc8ddb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bec0e77-ddab-4b7c-8be6-97213fcb88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.377s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:50:33 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Deleted volume successfully. Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bec0e77-ddab-4b7c-8be6-97213fcb88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1561918586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a38306-86cc-4bb2-9f52-62d7a7629bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003fa7894076458e8fc3f3ac32fe9d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:34Z,use_quota=True,user_id='1ad1a1e8221d4f4684fcb26c47c5bc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce50b04-ee04-4eb9-9a8c-97640ded4690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce50b04-ee04-4eb9-9a8c-97640ded4690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dc2123-369d-4866-bd2c-b6665163a050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dc2123-369d-4866-bd2c-b6665163a050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a38306-86cc-4bb2-9f52-62d7a7629bd0', 'volume_name': 'volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daae0cc4-b505-4542-8ce4-c24e067b757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daae0cc4-b505-4542-8ce4-c24e067b757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33757257-1e47-47d6-8672-38c6220fef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:33 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Volume 00a38306-86cc-4bb2-9f52-62d7a7629bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0', 'volume_size': 1} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1561918586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a38306-86cc-4bb2-9f52-62d7a7629bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003fa7894076458e8fc3f3ac32fe9d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:34Z,use_quota=True,user_id='1ad1a1e8221d4f4684fcb26c47c5bc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Creating volume 00a38306-86cc-4bb2-9f52-62d7a7629bd0 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:50:33 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:33 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 1073741824 Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3afb50be-c0c2-4d30-8944-6d7f93526b90 tempest-AttachVolumeNegativeTest-1455610819 None] Lock "cinder-2bdd9fc2-96ca-4aef-80eb-3b9473fb81e0-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:33 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-6ae3cbdf-e23e-42a8-befd-75de61591103 req-16d1bf75-4878-4fb7-bba1-bb6df01fb660 tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:34 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 1073741824" returned: 0 in 0.564s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:34 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 Sep 08 13:50:34 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:34 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-6ae3cbdf-e23e-42a8-befd-75de61591103 req-16d1bf75-4878-4fb7-bba1-bb6df01fb660 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.682s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33757257-1e47-47d6-8672-38c6220fef59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5279bd-4548-42cb-8721-0ff8b1f6a7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-6ae3cbdf-e23e-42a8-befd-75de61591103 req-16d1bf75-4878-4fb7-bba1-bb6df01fb660 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:34 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Volume volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 (00a38306-86cc-4bb2-9f52-62d7a7629bd0): created successfully Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5279bd-4548-42cb-8721-0ff8b1f6a7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Flow 'volume_create_manager' (c62ff5e4-8bd0-4e64-b75e-329cdc8ddb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-73935a48-ebc7-4f29-a20b-1f589d589e23 tempest-ServersNegativeTestJSON-235222217 None] Created volume successfully. Sep 08 13:50:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-6ae3cbdf-e23e-42a8-befd-75de61591103 req-16d1bf75-4878-4fb7-bba1-bb6df01fb660 tempest-ServerActionsTestOtherA-1703642632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-1d145e81-5d9d-4022-86eb-c93def49013a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0c4143c-4fd8-4e72-8007-f0f569603d84', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:50:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-6ae3cbdf-e23e-42a8-befd-75de61591103 req-16d1bf75-4878-4fb7-bba1-bb6df01fb660 tempest-ServerActionsTestOtherA-1703642632 None] attachment_update completed successfully. Sep 08 13:50:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "cinder-00a38306-86cc-4bb2-9f52-62d7a7629bd0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Lock "cinder-00a38306-86cc-4bb2-9f52-62d7a7629bd0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "cinder-quobyte-00a38306-86cc-4bb2-9f52-62d7a7629bd0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Lock "cinder-quobyte-00a38306-86cc-4bb2-9f52-62d7a7629bd0" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:36 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e24b78-33f1-43f2-95d5-eee32eb6728a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:36 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 Sep 08 13:50:36 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:37 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0" returned: 0 in 0.769s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:37 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0 Sep 08 13:50:37 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:37 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-00a38306-86cc-4bb2-9f52-62d7a7629bd0" returned: 0 in 0.365s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Lock "cinder-quobyte-00a38306-86cc-4bb2-9f52-62d7a7629bd0" released by "delete_volume" :: held 1.221s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:37 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Created reservations ['fe9fd7ed-eb2d-4a80-a574-8de32fbef3fa', '95cab84a-a664-4fd0-8801-85a0ab7d50a7', 'bf025330-5473-4add-8337-7df000461b23', '2dc17f00-9b9b-4e28-9821-685abd623516'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:38 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:50:38 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:38 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.366s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:50:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Deleted volume successfully. Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-516aafae-13e3-4a45-ba98-18c6c83954b2 tempest-ServersNegativeTestJSON-235222217 None] Lock "cinder-00a38306-86cc-4bb2-9f52-62d7a7629bd0-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "cinder-143edcb3-5578-4b97-9dec-cc6a8ee3a3de-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Lock "cinder-143edcb3-5578-4b97-9dec-cc6a8ee3a3de-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "cinder-quobyte-143edcb3-5578-4b97-9dec-cc6a8ee3a3de" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Lock "cinder-quobyte-143edcb3-5578-4b97-9dec-cc6a8ee3a3de" acquired by "delete_volume" :: waited 0.040s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:39 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5858f4df-a38c-4135-9737-24a05d51bf80]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:39 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de Sep 08 13:50:39 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:39 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:50:39 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Flow 'volume_create_manager' (fd917a10-413a-4c0a-80ae-2e91748bc109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94976287-f79b-45dc-a952-68f7a6f72f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de" returned: 0 in 0.811s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94976287-f79b-45dc-a952-68f7a6f72f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1160146303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e22044f-0ed9-4bf1-961d-42823fb9fc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7ce48126014ef1aca8dd52068080c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:40Z,use_quota=True,user_id='0750f7adeeb1424b88c283f8ffb6cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b00623a-d475-40f3-8e3b-95ac53ac81c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:40 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de Sep 08 13:50:40 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b00623a-d475-40f3-8e3b-95ac53ac81c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a13b8cd-5afd-47e8-b353-ac08877c5efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a13b8cd-5afd-47e8-b353-ac08877c5efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e22044f-0ed9-4bf1-961d-42823fb9fc82', 'volume_name': 'volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6515c6c-26e8-4b22-a8c1-35d240fb9d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6515c6c-26e8-4b22-a8c1-35d240fb9d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644c2b2b-0b3e-499e-bf6d-7e3a677c3134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:40 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Volume 3e22044f-0ed9-4bf1-961d-42823fb9fc82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82', 'volume_size': 1} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1160146303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e22044f-0ed9-4bf1-961d-42823fb9fc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7ce48126014ef1aca8dd52068080c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:40Z,use_quota=True,user_id='0750f7adeeb1424b88c283f8ffb6cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Creating volume 3e22044f-0ed9-4bf1-961d-42823fb9fc82 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:50:40 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:40 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 1073741824 Sep 08 13:50:40 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:40 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-143edcb3-5578-4b97-9dec-cc6a8ee3a3de" returned: 0 in 0.683s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Lock "cinder-quobyte-143edcb3-5578-4b97-9dec-cc6a8ee3a3de" released by "delete_volume" :: held 1.608s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:40 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Created reservations ['104dd11d-6db1-4bb6-a00f-8477cbd0b793', '7acc5112-b5ae-451d-9438-e733ff5607b9', 'b72cdfed-881b-441d-be52-eb186f6007f8', '420495cf-71c5-436b-a7c0-700fe5b54f80'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:41 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 1073741824" returned: 0 in 0.955s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:41 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:50:41 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:41 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 Sep 08 13:50:41 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:41 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82" returned: 0 in 0.568s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644c2b2b-0b3e-499e-bf6d-7e3a677c3134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12590e45-fdeb-4bdd-9afc-a48838070837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:41 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.779s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:50:41 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Volume volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 (3e22044f-0ed9-4bf1-961d-42823fb9fc82): created successfully Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12590e45-fdeb-4bdd-9afc-a48838070837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Flow 'volume_create_manager' (fd917a10-413a-4c0a-80ae-2e91748bc109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Deleted volume successfully. Sep 08 13:50:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b3bea149-ec5d-46e6-8922-2336fc503a1e tempest-AttachVolumeTestJSON-104748426 None] Created volume successfully. Sep 08 13:50:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-83f36204-f178-4f5b-aff1-50c23ced67fc tempest-ServersNegativeTestJSON-235222217 None] Lock "cinder-143edcb3-5578-4b97-9dec-cc6a8ee3a3de-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-71b06f90-1ac8-4c55-a4eb-4e860dc534b7 req-4691ecef-074b-4c7c-accd-4d7c5a438d3b tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-71b06f90-1ac8-4c55-a4eb-4e860dc534b7 req-4691ecef-074b-4c7c-accd-4d7c5a438d3b tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-71b06f90-1ac8-4c55-a4eb-4e860dc534b7 req-4691ecef-074b-4c7c-accd-4d7c5a438d3b tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-71b06f90-1ac8-4c55-a4eb-4e860dc534b7 req-4691ecef-074b-4c7c-accd-4d7c5a438d3b tempest-AttachVolumeTestJSON-104748426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '483c8b1c-5d2c-4b33-bbbb-c484412d5cac', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:50:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-71b06f90-1ac8-4c55-a4eb-4e860dc534b7 req-4691ecef-074b-4c7c-accd-4d7c5a438d3b tempest-AttachVolumeTestJSON-104748426 None] attachment_update completed successfully. Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Flow 'volume_create_manager' (5ffc2473-f818-422a-9eca-85956910fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b085f4-b8d3-4c70-8fab-cdab644770a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b085f4-b8d3-4c70-8fab-cdab644770a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-506193302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7baa1a22-420a-4bf1-9ab1-6fe98011eb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7ce48126014ef1aca8dd52068080c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:47Z,use_quota=True,user_id='0750f7adeeb1424b88c283f8ffb6cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f5feeb-594d-4d7b-be30-011c17bb0343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f5feeb-594d-4d7b-be30-011c17bb0343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f553d5ae-775f-46db-92b4-b44a0ee69afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f553d5ae-775f-46db-92b4-b44a0ee69afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7baa1a22-420a-4bf1-9ab1-6fe98011eb86', 'volume_name': 'volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa8fdbb-0923-46ab-bffe-9a3c6041e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa8fdbb-0923-46ab-bffe-9a3c6041e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fc2a38-fc48-4fa2-bce1-6cfe02e81eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:46 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Volume 7baa1a22-420a-4bf1-9ab1-6fe98011eb86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86', 'volume_size': 1} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-506193302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7baa1a22-420a-4bf1-9ab1-6fe98011eb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7ce48126014ef1aca8dd52068080c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:47Z,use_quota=True,user_id='0750f7adeeb1424b88c283f8ffb6cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Creating volume 7baa1a22-420a-4bf1-9ab1-6fe98011eb86 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:50:46 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:50:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:47 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 1073741824 Sep 08 13:50:47 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Flow 'volume_create_manager' (72c73f79-8449-4c2c-8650-a042cb0504d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2319d02e-c35c-4e77-906f-01bfbcf89761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2319d02e-c35c-4e77-906f-01bfbcf89761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1774251557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c287c4fd-34f0-4ca5-8ec6-82024c7c12d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bff1665794848c884e2502d58c641ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:47Z,use_quota=True,user_id='aee5e05dd2834acca9e7086c1f94e02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3744d64-e63e-4c1f-ab94-c815e578652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3744d64-e63e-4c1f-ab94-c815e578652d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca02ed35-30ba-46ba-bebe-2a1fa790a70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca02ed35-30ba-46ba-bebe-2a1fa790a70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c287c4fd-34f0-4ca5-8ec6-82024c7c12d0', 'volume_name': 'volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8086b3b-0ac7-4842-88ce-a82f317427a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8086b3b-0ac7-4842-88ce-a82f317427a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53672820-1eae-43d5-b9e2-f87406f12e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:47 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Volume c287c4fd-34f0-4ca5-8ec6-82024c7c12d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0', 'volume_size': 1} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:47 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 1073741824" returned: 0 in 0.530s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:47 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 Sep 08 13:50:47 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:47 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86" returned: 0 in 0.308s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.577s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1774251557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c287c4fd-34f0-4ca5-8ec6-82024c7c12d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bff1665794848c884e2502d58c641ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:50:47Z,use_quota=True,user_id='aee5e05dd2834acca9e7086c1f94e02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Creating volume c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:50:47 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fc2a38-fc48-4fa2-bce1-6cfe02e81eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:47 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 1073741824 Sep 08 13:50:47 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4dc124-2f80-49f5-9abe-628d9c22579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:47 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Volume volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 (7baa1a22-420a-4bf1-9ab1-6fe98011eb86): created successfully Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4dc124-2f80-49f5-9abe-628d9c22579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Flow 'volume_create_manager' (5ffc2473-f818-422a-9eca-85956910fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:47 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b11cd9c5-1028-432f-8c6d-d0dfe16c84e7 tempest-AttachVolumeTestJSON-104748426 None] Created volume successfully. Sep 08 13:50:48 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 1073741824" returned: 0 in 0.536s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:48 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 Sep 08 13:50:48 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:48 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" returned: 0 in 0.288s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53672820-1eae-43d5-b9e2-f87406f12e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735fd265-364e-42c1-b253-7c47301209d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:50:48 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Volume volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 (c287c4fd-34f0-4ca5-8ec6-82024c7c12d0): created successfully Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735fd265-364e-42c1-b253-7c47301209d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:50:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Flow 'volume_create_manager' (72c73f79-8449-4c2c-8650-a042cb0504d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:50:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-881d1505-a5cf-4479-822f-16f67c2683a8 req-43a6cfb5-e44b-434d-903a-548bcd745851 tempest-VolumesSnapshotsTestJSON-1636356188 None] Created volume successfully. Sep 08 13:50:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-7a769555-45d1-453e-8120-f1d454b5be68 req-85e9a801-97b5-4b63-affd-68c299006dbc tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Creating offline snapshot 9798cb22-a840-461b-a890-99390a4316cd of volume c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:50:49 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a03f22-06f8-4d66-adca-ff00b1365036]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:50 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 Sep 08 13:50:50 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:50 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" returned: 0 in 0.431s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:50 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd 1G Sep 08 13:50:50 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:50 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd 1G" returned: 0 in 0.424s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:50 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd Sep 08 13:50:50 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:51 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd" returned: 0 in 0.463s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:51 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd is being set with open permissions: ugo+rw Sep 08 13:50:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:51 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd Sep 08 13:50:51 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:51 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd" returned: 0 in 0.302s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:51 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.info Sep 08 13:50:51 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:51 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.info" returned: 0 in 0.294s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:51 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.info is being set with open permissions: ugo+rw Sep 08 13:50:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:51 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.info Sep 08 13:50:51 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.info" returned: 0 in 0.378s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:52 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-7a769555-45d1-453e-8120-f1d454b5be68 req-85e9a801-97b5-4b63-affd-68c299006dbc tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.410s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-7a769555-45d1-453e-8120-f1d454b5be68 req-85e9a801-97b5-4b63-affd-68c299006dbc tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:52 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-bac9277b-513d-4253-a3d8-e2714bcbb33d req-096b2728-35f4-444a-ac42-7314321c7c48 tempest-VolumesSnapshotsTestJSON-1636356188 None] Create snapshot completed successfully Sep 08 13:50:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-7a769555-45d1-453e-8120-f1d454b5be68 req-85e9a801-97b5-4b63-affd-68c299006dbc tempest-AttachVolumeTestJSON-104748426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94fc2c40-bb85-4b86-8975-06d544bc6a54', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:50:52 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-7a769555-45d1-453e-8120-f1d454b5be68 req-85e9a801-97b5-4b63-affd-68c299006dbc tempest-AttachVolumeTestJSON-104748426 None] attachment_update completed successfully. Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "cinder-9798cb22-a840-461b-a890-99390a4316cd-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-9798cb22-a840-461b-a890-99390a4316cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "cinder-quobyte-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-quobyte-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "cinder-quobyte-9798cb22-a840-461b-a890-99390a4316cd" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-quobyte-9798cb22-a840-461b-a890-99390a4316cd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Deleting offline snapshot 9798cb22-a840-461b-a890-99390a4316cd of volume c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] snapshot_file for this snap is: volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[787c0549-0117-4d6c-8f6e-98f34b00ba5a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:53 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd Sep 08 13:50:53 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:54 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd" returned: 0 in 0.464s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:50:54 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[91954ebc-a234-4877-9111-dfc5d94626b8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:54 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 Sep 08 13:50:54 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:54 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" returned: 0 in 0.502s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:54 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd Sep 08 13:50:54 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:55 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd" returned: 0 in 0.445s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:55 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd Sep 08 13:50:55 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-952fba9a-15a4-462d-b466-c3934f45f979 req-419976a5-b76b-4135-8acc-0e036cb30815 tempest-AttachVolumeTestJSON-104748426 None] Terminate volume connection completed successfully. Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-952fba9a-15a4-462d-b466-c3934f45f979 req-419976a5-b76b-4135-8acc-0e036cb30815 tempest-AttachVolumeTestJSON-104748426 None] Deleting attachment 483c8b1c-5d2c-4b33-bbbb-c484412d5cac. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:50:55 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0.9798cb22-a840-461b-a890-99390a4316cd" returned: 0 in 0.420s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-quobyte-9798cb22-a840-461b-a890-99390a4316cd" released by "_delete_snapshot" :: held 1.949s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-quobyte-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" released by "delete_snapshot" :: held 1.985s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:55 devstack cinder-volume[87262]: WARNING cinder.quota [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG cinder.quota [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Created reservations ['98322dc8-1998-4ad5-bf0b-6c39ed9e571a', 'd68b3f13-6b7f-4961-b5a3-c6ec15ffe1fd', '782ea847-60b2-4094-921a-83fe63ef9dd9', 'd17020f7-60fa-424a-85df-321d32bc37fb'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:50:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Delete snapshot completed successfully. Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-fdf0d5a8-5a84-4c58-b4f3-c6f8ae821b30 req-9b59a477-51a5-4814-a2ce-7f803a6b8e41 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-9798cb22-a840-461b-a890-99390a4316cd-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "cinder-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "cinder-quobyte-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:50:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-quobyte-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" acquired by "delete_volume" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:50:56 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f0b0d6-efb4-4459-8713-72317901274b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:50:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:56 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 Sep 08 13:50:56 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:56 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-2c42f8f0-7f0a-47cc-b194-adb53068dad2 req-631924d9-50da-4054-9f56-f3bf22303d03 tempest-AttachVolumeTestJSON-104748426 None] Terminate volume connection completed successfully. Sep 08 13:50:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-2c42f8f0-7f0a-47cc-b194-adb53068dad2 req-631924d9-50da-4054-9f56-f3bf22303d03 tempest-AttachVolumeTestJSON-104748426 None] Deleting attachment 94fc2c40-bb85-4b86-8975-06d544bc6a54. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:50:56 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" returned: 0 in 0.631s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:56 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0 Sep 08 13:50:56 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:57 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" returned: 0 in 0.452s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-quobyte-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0" released by "delete_volume" :: held 1.179s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG cinder.quota [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Created reservations ['7c68febd-b358-44e7-bb4b-1b1ca497f1da', 'dc95fef8-56d4-405e-b43d-41716ced101d', '9e5bcfe9-0d14-4c90-bcea-5b74a34fe4f3', 'ff2535bd-1ba9-4da2-8c4f-492dca18216c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:50:57 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:50:57 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:50:57 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.287s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG cinder.manager [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:50:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Deleted volume successfully. Sep 08 13:50:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-6ebdaa92-e179-4d53-9820-4c41e81d1108 req-527612b8-586e-482e-b109-6cfd8c827f25 tempest-VolumesSnapshotsTestJSON-1636356188 None] Lock "cinder-c287c4fd-34f0-4ca5-8ec6-82024c7c12d0-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:03 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:03 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:03 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.317s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 28 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:51:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:51:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "cinder-7baa1a22-420a-4bf1-9ab1-6fe98011eb86-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-7baa1a22-420a-4bf1-9ab1-6fe98011eb86-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "cinder-quobyte-7baa1a22-420a-4bf1-9ab1-6fe98011eb86" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-quobyte-7baa1a22-420a-4bf1-9ab1-6fe98011eb86" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bb7ef1-9aeb-42c4-93e1-6e1c4ea2bf51]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:05 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 Sep 08 13:51:05 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Flow 'volume_create_manager' (edcdc98d-ed6f-4f92-821f-89068c89d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fef78a-3548-4a3a-b8b4-c64792ed279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fef78a-3548-4a3a-b8b4-c64792ed279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-990065409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc4648d-a212-4615-ab03-c601a74e787a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb691884ec44493695e49b3c18b4a90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:06Z,use_quota=True,user_id='6a0ebf288c834e46bd71c19325efa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cff423-ad2e-48f1-8359-6a9b0d8f0d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cff423-ad2e-48f1-8359-6a9b0d8f0d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0267cc-4b4b-4034-a7c0-c477ff144a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0267cc-4b4b-4034-a7c0-c477ff144a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdc4648d-a212-4615-ab03-c601a74e787a', 'volume_name': 'volume-fdc4648d-a212-4615-ab03-c601a74e787a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628d5a07-1e68-43dc-871a-10ac24281587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:05 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628d5a07-1e68-43dc-871a-10ac24281587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7e7a29-631d-4b0e-a5ae-3e98ce6af647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:05 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Volume fdc4648d-a212-4615-ab03-c601a74e787a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdc4648d-a212-4615-ab03-c601a74e787a', 'volume_size': 1} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-990065409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc4648d-a212-4615-ab03-c601a74e787a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb691884ec44493695e49b3c18b4a90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:06Z,use_quota=True,user_id='6a0ebf288c834e46bd71c19325efa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Creating volume fdc4648d-a212-4615-ab03-c601a74e787a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:51:05 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86" returned: 0 in 0.548s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:05 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a 1073741824 Sep 08 13:51:05 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:05 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86 Sep 08 13:51:05 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:06 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7baa1a22-420a-4bf1-9ab1-6fe98011eb86" returned: 0 in 0.333s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-quobyte-7baa1a22-420a-4bf1-9ab1-6fe98011eb86" released by "delete_volume" :: held 0.943s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Created reservations ['c1a24183-383c-4383-9777-438e3f850828', 'c2edf1f9-b10a-44e0-b537-0a0a5b40f16a', '0f4a4d85-8e42-4136-86c4-3caeca192708', '93b32bf4-e740-4b70-b55a-93697ac0835f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:06 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:06 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:06 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a 1073741824" returned: 0 in 0.612s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:06 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a Sep 08 13:51:06 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:06 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.336s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:06 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Deleted volume successfully. Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c1c76eeb-c35b-43c7-863b-49cd930537ec tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-7baa1a22-420a-4bf1-9ab1-6fe98011eb86-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:06 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a" returned: 0 in 0.448s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7e7a29-631d-4b0e-a5ae-3e98ce6af647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc4648d-a212-4615-ab03-c601a74e787a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c99be4a-0520-4264-ba53-abcf714b38a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:06 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Volume volume-fdc4648d-a212-4615-ab03-c601a74e787a (fdc4648d-a212-4615-ab03-c601a74e787a): created successfully Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c99be4a-0520-4264-ba53-abcf714b38a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Flow 'volume_create_manager' (edcdc98d-ed6f-4f92-821f-89068c89d898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:06 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cfa10556-10b2-4a9d-a127-dabedd0490dd tempest-VolumesTestJSON-463236545 None] Created volume successfully. Sep 08 13:51:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "cinder-3e22044f-0ed9-4bf1-961d-42823fb9fc82-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-3e22044f-0ed9-4bf1-961d-42823fb9fc82-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "cinder-quobyte-3e22044f-0ed9-4bf1-961d-42823fb9fc82" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-quobyte-3e22044f-0ed9-4bf1-961d-42823fb9fc82" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:07 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d1baf9-ab8f-40d7-919b-c61d15ddfe64]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:07 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 Sep 08 13:51:07 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:07 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82" returned: 0 in 0.443s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:07 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82 Sep 08 13:51:07 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:08 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3e22044f-0ed9-4bf1-961d-42823fb9fc82" returned: 0 in 0.287s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-quobyte-3e22044f-0ed9-4bf1-961d-42823fb9fc82" released by "delete_volume" :: held 0.786s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Created reservations ['c14401c5-10f6-4c2c-8fd0-e94e97117b47', '87bc51db-3e02-4801-902e-dc5f00434a44', 'e8c822df-0d7d-43c5-87e4-2705fcef1a97', 'a8906016-50ed-4091-b5f0-575d8deda316'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:08 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:08 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:51:08 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Flow 'volume_create_manager' (9897427f-268a-411c-a485-8c342fd363bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea997fc1-e8f3-4871-ac77-edd78e72a732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "cinder-0556513f-1687-4caa-83cb-3a6ae5348fbc-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.402s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea997fc1-e8f3-4871-ac77-edd78e72a732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-562858580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b9a0d1-4602-463c-a6dc-538b4fcf9b5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb691884ec44493695e49b3c18b4a90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:09Z,use_quota=True,user_id='6a0ebf288c834e46bd71c19325efa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6435746e-ef0d-43fb-af1f-444e163da1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6435746e-ef0d-43fb-af1f-444e163da1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182fa979-8392-4806-af4c-eb1c4a48abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182fa979-8392-4806-af4c-eb1c4a48abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b9a0d1-4602-463c-a6dc-538b4fcf9b5e', 'volume_name': 'volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904db89c-5965-4fe2-84ac-53cc1caea1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904db89c-5965-4fe2-84ac-53cc1caea1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3d99bb-5bd4-4a05-96f2-90e8ad33da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:08 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Volume 87b9a0d1-4602-463c-a6dc-538b4fcf9b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e', 'volume_size': 1} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-562858580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b9a0d1-4602-463c-a6dc-538b4fcf9b5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb691884ec44493695e49b3c18b4a90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:09Z,use_quota=True,user_id='6a0ebf288c834e46bd71c19325efa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Creating volume 87b9a0d1-4602-463c-a6dc-538b4fcf9b5e {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:51:08 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-0556513f-1687-4caa-83cb-3a6ae5348fbc-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Deleted volume successfully. Sep 08 13:51:08 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e 1073741824 Sep 08 13:51:08 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e9e1662-141c-4dad-b004-3c63c155bac8 tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-3e22044f-0ed9-4bf1-961d-42823fb9fc82-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "cinder-quobyte-0556513f-1687-4caa-83cb-3a6ae5348fbc" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-quobyte-0556513f-1687-4caa-83cb-3a6ae5348fbc" acquired by "delete_volume" :: waited 0.062s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[527971c5-e4c7-4982-8dc8-a10362f483a0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:09 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc Sep 08 13:51:09 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:09 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e 1073741824" returned: 0 in 0.648s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:09 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc" returned: 0 in 0.435s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:09 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:09 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:09 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e Sep 08 13:51:09 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:09 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0556513f-1687-4caa-83cb-3a6ae5348fbc" returned: 0 in 0.298s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:09 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e" returned: 0 in 0.276s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-quobyte-0556513f-1687-4caa-83cb-3a6ae5348fbc" released by "delete_volume" :: held 0.809s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3d99bb-5bd4-4a05-96f2-90e8ad33da21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a67b95-b4bd-4e2f-8e1b-5342932c33dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:09 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Volume volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e (87b9a0d1-4602-463c-a6dc-538b4fcf9b5e): created successfully Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a67b95-b4bd-4e2f-8e1b-5342932c33dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Flow 'volume_create_manager' (9897427f-268a-411c-a485-8c342fd363bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:09 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8bcfeb02-90a9-4e76-9ee8-db023151193e tempest-VolumesTestJSON-463236545 None] Created volume successfully. Sep 08 13:51:09 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Created reservations ['8e23228b-8607-4f44-bce3-54856fb7d86d', '8fc3a4af-f262-40a9-bf36-5631a831ee71', '8503e3db-805e-4e2f-845f-cf2f77c223f4', 'ef9c8c0c-5880-40fc-ab04-7c952bd51545'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:10 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:10 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:10 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Deleted volume successfully. Sep 08 13:51:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ba39d5fa-3aed-4e1e-9e7a-6b431181d194 tempest-AttachVolumeTestJSON-104748426 None] Lock "cinder-0556513f-1687-4caa-83cb-3a6ae5348fbc-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Flow 'volume_create_manager' (110bbec4-45cd-4cfa-af75-4f6d38f82dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9dcab6-aa96-4f04-93e6-b675037ee013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9dcab6-aa96-4f04-93e6-b675037ee013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1937815879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73134d0-ee60-427e-9865-2f5dd743c627,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb691884ec44493695e49b3c18b4a90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:11Z,use_quota=True,user_id='6a0ebf288c834e46bd71c19325efa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bf7261-1fe5-48b8-9a1f-021e7fde7ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bf7261-1fe5-48b8-9a1f-021e7fde7ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300fc7d0-da38-44a0-9f59-2420d1d28056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300fc7d0-da38-44a0-9f59-2420d1d28056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73134d0-ee60-427e-9865-2f5dd743c627', 'volume_name': 'volume-d73134d0-ee60-427e-9865-2f5dd743c627', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfbf7bf-bb49-4997-8a8b-69ad1251454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfbf7bf-bb49-4997-8a8b-69ad1251454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffb7f6e-0083-4bef-a34a-232289f6795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:11 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Volume d73134d0-ee60-427e-9865-2f5dd743c627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73134d0-ee60-427e-9865-2f5dd743c627', 'volume_size': 1} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1937815879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73134d0-ee60-427e-9865-2f5dd743c627,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb691884ec44493695e49b3c18b4a90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:11Z,use_quota=True,user_id='6a0ebf288c834e46bd71c19325efa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Creating volume d73134d0-ee60-427e-9865-2f5dd743c627 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:51:11 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:51:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:11 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 1073741824 Sep 08 13:51:11 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:12 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 1073741824" returned: 0 in 0.629s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:12 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 Sep 08 13:51:12 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:12 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627" returned: 0 in 0.338s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffb7f6e-0083-4bef-a34a-232289f6795e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73134d0-ee60-427e-9865-2f5dd743c627', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7984c401-011c-4d4d-8d61-c8260827dae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Volume volume-d73134d0-ee60-427e-9865-2f5dd743c627 (d73134d0-ee60-427e-9865-2f5dd743c627): created successfully Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7984c401-011c-4d4d-8d61-c8260827dae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Flow 'volume_create_manager' (110bbec4-45cd-4cfa-af75-4f6d38f82dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:12 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6993369a-8742-4824-a080-f379b9c1d802 tempest-VolumesTestJSON-463236545 None] Created volume successfully. Sep 08 13:51:14 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-eaefd0e3-14d7-455c-aaac-1a042af6853f tempest-ServerActionsTestOtherA-1703642632 None] Terminate volume connection completed successfully. Sep 08 13:51:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-eaefd0e3-14d7-455c-aaac-1a042af6853f tempest-ServerActionsTestOtherA-1703642632 None] Deleting attachment e0c4143c-4fd8-4e72-8007-f0f569603d84. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:51:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "cinder-1d145e81-5d9d-4022-86eb-c93def49013a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Lock "cinder-1d145e81-5d9d-4022-86eb-c93def49013a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "cinder-quobyte-1d145e81-5d9d-4022-86eb-c93def49013a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Lock "cinder-quobyte-1d145e81-5d9d-4022-86eb-c93def49013a" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:14 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d5a88c-4169-4b93-8db8-1287e37e88b4]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:14 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a Sep 08 13:51:14 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:15 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a" returned: 0 in 0.709s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:15 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a Sep 08 13:51:15 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "cinder-c47a0de8-71d1-41c1-95c3-8eba6be112ed-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Lock "cinder-c47a0de8-71d1-41c1-95c3-8eba6be112ed-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "cinder-quobyte-c47a0de8-71d1-41c1-95c3-8eba6be112ed" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Lock "cinder-quobyte-c47a0de8-71d1-41c1-95c3-8eba6be112ed" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Acquiring lock "cinder-d73134d0-ee60-427e-9865-2f5dd743c627-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c23bb11-8d49-424a-b533-be98b179bafb]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Lock "cinder-d73134d0-ee60-427e-9865-2f5dd743c627-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Acquiring lock "cinder-quobyte-d73134d0-ee60-427e-9865-2f5dd743c627" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Lock "cinder-quobyte-d73134d0-ee60-427e-9865-2f5dd743c627" acquired by "delete_volume" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:15 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1d145e81-5d9d-4022-86eb-c93def49013a" returned: 0 in 0.503s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:15 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed Sep 08 13:51:15 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Lock "cinder-quobyte-1d145e81-5d9d-4022-86eb-c93def49013a" released by "delete_volume" :: held 1.298s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[962d8ac3-5323-4964-a3e5-dee4125e256c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.quota [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Created reservations ['214da0b2-1098-407c-a654-f0eac6a10afe', '5c8f5b5f-cc1a-49d1-b3dd-5bba6691065c', 'ff9b88aa-11fb-4006-9d64-cffc4d66bb5a', 'c245e057-3f08-45df-9864-7f54508afa73'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:16 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 Sep 08 13:51:16 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:16 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:16 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:16 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed" returned: 0 in 0.532s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:16 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed Sep 08 13:51:16 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:16 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.300s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.manager [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:16 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Deleted volume successfully. Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-aa5b0967-b622-4020-8d38-a6cb95d3a682 req-8f649ac9-d10e-4ac5-bf51-deb47cb79309 tempest-ServerActionsTestOtherA-1703642632 None] Lock "cinder-1d145e81-5d9d-4022-86eb-c93def49013a-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:16 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627" returned: 0 in 0.570s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:16 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627 Sep 08 13:51:16 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:16 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c47a0de8-71d1-41c1-95c3-8eba6be112ed" returned: 0 in 0.323s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Lock "cinder-quobyte-c47a0de8-71d1-41c1-95c3-8eba6be112ed" released by "delete_volume" :: held 0.949s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Created reservations ['85795b4d-2d0f-440f-b45c-cab6209df1cc', '2b6fb6f9-a5ae-4780-90d5-39acf233d1e3', 'd212ac10-7a7f-423e-84e3-8fc5b060ac2b', '56ba22e6-5381-45a0-b9fd-d958da9c4074'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:16 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:16 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:16 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d73134d0-ee60-427e-9865-2f5dd743c627" returned: 0 in 0.332s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Lock "cinder-quobyte-d73134d0-ee60-427e-9865-2f5dd743c627" released by "delete_volume" :: held 0.974s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:16 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Created reservations ['d3099c75-ae92-4349-8b7b-64a0e31028fe', '161b6937-63f7-44e7-a461-5fbbab7e7119', 'ab47aa5d-e524-4b78-8e48-6f5959f54575', '83ce021e-729f-493e-b902-40336dd7d29d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:17 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:17 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:17 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.294s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Deleted volume successfully. Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d66accf0-75fe-4a66-a824-71456e3a5f3e tempest-ServerActionsTestOtherA-1703642632 None] Lock "cinder-c47a0de8-71d1-41c1-95c3-8eba6be112ed-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:17 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.316s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Deleted volume successfully. Sep 08 13:51:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-59677b96-bbbf-4b69-af14-240b535e47f8 tempest-VolumesTestJSON-463236545 None] Lock "cinder-d73134d0-ee60-427e-9865-2f5dd743c627-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Acquiring lock "cinder-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Lock "cinder-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Acquiring lock "cinder-quobyte-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Lock "cinder-quobyte-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:18 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[333747a7-5f35-4172-adde-60cecb21f522]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:18 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e Sep 08 13:51:18 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:18 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e" returned: 0 in 0.634s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:18 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e Sep 08 13:51:18 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:19 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e" returned: 0 in 0.491s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Lock "cinder-quobyte-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e" released by "delete_volume" :: held 1.183s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Created reservations ['34948813-67eb-4388-bf1e-059048a0fe82', 'c83b69b5-6183-46c4-81f0-13ede47ffb2f', 'e663521a-9c28-462d-add5-59f19f8b8306', '505dd1b7-521f-48e5-b94e-c9a237eb2d47'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:19 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:19 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:20 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.477s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Deleted volume successfully. Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0f15e223-6759-4c58-a292-46bc6c34c084 tempest-VolumesTestJSON-463236545 None] Lock "cinder-87b9a0d1-4602-463c-a6dc-538b4fcf9b5e-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Acquiring lock "cinder-fdc4648d-a212-4615-ab03-c601a74e787a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Lock "cinder-fdc4648d-a212-4615-ab03-c601a74e787a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Acquiring lock "cinder-quobyte-fdc4648d-a212-4615-ab03-c601a74e787a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Lock "cinder-quobyte-fdc4648d-a212-4615-ab03-c601a74e787a" acquired by "delete_volume" :: waited 0.048s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6db0ee-5fbc-4bfe-ba03-a13b4c68bef3]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:21 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a Sep 08 13:51:21 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:21 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a" returned: 0 in 0.874s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:21 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a Sep 08 13:51:21 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:22 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fdc4648d-a212-4615-ab03-c601a74e787a" returned: 0 in 0.463s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Lock "cinder-quobyte-fdc4648d-a212-4615-ab03-c601a74e787a" released by "delete_volume" :: held 1.419s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=105,cinder:INSERT=31,cinder:UPDATE=130,cinder:DELETE=9 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=126,cinder:UPDATE=150,cinder:INSERT=34,cinder:DELETE=13 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Created reservations ['8703f6f2-d7b1-422d-8ecc-4d7973a13258', '1332540e-381b-46bf-80a7-8013ad958fb0', 'ca93b0f6-8181-4b86-9c1a-20e4d28f3f7e', 'b316a606-06b8-4b46-a2cd-86a46942c236'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:22 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:22 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:22 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.318s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Deleted volume successfully. Sep 08 13:51:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-909a0ba9-1cee-42d2-b415-5f2e378aff5e tempest-VolumesTestJSON-463236545 None] Lock "cinder-fdc4648d-a212-4615-ab03-c601a74e787a-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8695c4dd-bf77-41e1-8e92-8cfbc98a63cf tempest-BackendsCapabilitiesAdminTestsJSON-190195597 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5277214050293, 'free_capacity_gb': 1773.5277214050293, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87262) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 13:51:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fc0ae1f8-39da-44a9-8adc-b98a25563b62 tempest-BackendsCapabilitiesAdminTestsJSON-190195597 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5277214050293, 'free_capacity_gb': 1773.5277214050293, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87262) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 13:51:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f2727f8f-de05-4c61-9e62-40c459439814 tempest-GroupsTest-370172451 None] Group tempest-Group1-215940363: creating Sep 08 13:51:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f2727f8f-de05-4c61-9e62-40c459439814 tempest-GroupsTest-370172451 None] Group tempest-Group1-215940363: created successfully Sep 08 13:51:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f2727f8f-de05-4c61-9e62-40c459439814 tempest-GroupsTest-370172451 None] Create group completed successfully. Sep 08 13:51:35 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-58680802-bd8e-41c1-8e48-47671eed8088 tempest-GroupsTest-370172451 None] Group tempest-Group2-516292717: creating Sep 08 13:51:35 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-58680802-bd8e-41c1-8e48-47671eed8088 tempest-GroupsTest-370172451 None] Group tempest-Group2-516292717: created successfully Sep 08 13:51:35 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-58680802-bd8e-41c1-8e48-47671eed8088 tempest-GroupsTest-370172451 None] Create group completed successfully. Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Flow 'volume_create_manager' (af0f0887-273e-451d-8071-48129d9c5126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3904307-4ea6-4d24-854e-3b486287ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3904307-4ea6-4d24-854e-3b486287ed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1484952445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ccfb4d1-e059-4471-9a8b-86b0a3b641d0,host='devstack@QuobyteHD#QuobyteHD',id=b504f95e-25a5-46d6-84c0-d171b8a71b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d75bf3aab24244a0aec9ed2b499b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:37Z,use_quota=True,user_id='58c884ed3dd0451c8ad65e4dbb4ad119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36d2ec87-cac3-4a97-b7b6-690256138718),volume_type_id=36d2ec87-cac3-4a97-b7b6-690256138718)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8a8a46-dc15-4c4b-8925-ec95393066a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8a8a46-dc15-4c4b-8925-ec95393066a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db7a368-ee59-4906-a8d1-6ed21e9bee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db7a368-ee59-4906-a8d1-6ed21e9bee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b504f95e-25a5-46d6-84c0-d171b8a71b4a', 'volume_name': 'volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a40ecc-93e3-4f4b-8ae8-0e60fb9deecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a40ecc-93e3-4f4b-8ae8-0e60fb9deecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6898dc8-4fd1-416a-b9cc-40a9257f1a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:37 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Volume b504f95e-25a5-46d6-84c0-d171b8a71b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a', 'volume_size': 1} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ccfb4d1-e059-4471-9a8b-86b0a3b641d0,created_at=2026-09-08T11:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1484952445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ccfb4d1-e059-4471-9a8b-86b0a3b641d0,host='devstack@QuobyteHD#QuobyteHD',id=b504f95e-25a5-46d6-84c0-d171b8a71b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d75bf3aab24244a0aec9ed2b499b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:37Z,use_quota=True,user_id='58c884ed3dd0451c8ad65e4dbb4ad119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36d2ec87-cac3-4a97-b7b6-690256138718),volume_type_id=36d2ec87-cac3-4a97-b7b6-690256138718)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Creating volume b504f95e-25a5-46d6-84c0-d171b8a71b4a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:51:37 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:37 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a 1073741824 Sep 08 13:51:37 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:37 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a 1073741824" returned: 0 in 0.447s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:37 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a Sep 08 13:51:37 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:38 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a" returned: 0 in 0.298s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:51:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6898dc8-4fd1-416a-b9cc-40a9257f1a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476db3f0-6a4f-4d5b-b901-42e68e3a8ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:38 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Volume volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a (b504f95e-25a5-46d6-84c0-d171b8a71b4a): created successfully Sep 08 13:51:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476db3f0-6a4f-4d5b-b901-42e68e3a8ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Flow 'volume_create_manager' (af0f0887-273e-451d-8071-48129d9c5126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1367cabc-fd6d-412d-8b3a-705334877284 tempest-GroupsTest-370172451 None] Created volume successfully. Sep 08 13:51:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-aef0437e-178d-413a-9e7c-da25e4e5dc4b tempest-GroupsV320Test-1225043657 None] Group tempest-GroupsV320Test-Group-889157982: creating Sep 08 13:51:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-aef0437e-178d-413a-9e7c-da25e4e5dc4b tempest-GroupsV320Test-1225043657 None] Group tempest-GroupsV320Test-Group-889157982: created successfully Sep 08 13:51:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-aef0437e-178d-413a-9e7c-da25e4e5dc4b tempest-GroupsV320Test-1225043657 None] Create group completed successfully. Sep 08 13:51:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Acquiring lock "cinder-quobyte-b504f95e-25a5-46d6-84c0-d171b8a71b4a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Lock "cinder-quobyte-b504f95e-25a5-46d6-84c0-d171b8a71b4a" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:39 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a472333-99cc-4706-b758-ee4ad8604ab3]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:39 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a Sep 08 13:51:39 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:39 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a" returned: 0 in 0.432s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:39 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a Sep 08 13:51:39 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:40 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b504f95e-25a5-46d6-84c0-d171b8a71b4a" returned: 0 in 0.365s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Lock "cinder-quobyte-b504f95e-25a5-46d6-84c0-d171b8a71b4a" released by "delete_volume" :: held 0.847s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Created reservations ['2a5b9365-df16-4f93-9986-4829363ae17a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Created reservations ['8de8ed22-59f9-4ebb-9904-2bad0668a71e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:40 devstack cinder-volume[87262]: WARNING cinder.quota [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2097365154 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2097365154, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:51:40 devstack cinder-volume[87262]: WARNING cinder.quota [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2097365154 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2097365154, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Created reservations ['352e0bb1-4670-4534-98a9-3fa5e5820a08', '761f20af-4e51-4b38-bcfd-db27a06aa815', 'facc46bf-2003-4697-a363-bb87be843695', 'fe5399f6-84eb-4fe4-91b7-a4213964ad71'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:40 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:40 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:40 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:40 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Created reservations ['e3356a49-61d8-4e33-8e7b-b6a353ab98b7'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:40 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.520s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:40 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.405s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:40 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:40 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:40 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b16bb380-51e2-4e12-b153-11613454ec57 tempest-GroupsV320Test-1225043657 None] Delete group completed successfully. Sep 08 13:51:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-69c8237b-c91f-4fa2-9741-eb59a6058d5e tempest-GroupsTest-370172451 None] Delete group completed successfully. Sep 08 13:51:41 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.280s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:41 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7ccf6f35-6b68-412b-b89c-be378288298e tempest-GroupsTest-370172451 None] Delete group completed successfully. Sep 08 13:51:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-37dfc14a-19be-43a4-89f3-daac1aa43b93 tempest-GroupsTest-370172451 None] Group tempest-GroupsTest-Group-397926470: creating Sep 08 13:51:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-37dfc14a-19be-43a4-89f3-daac1aa43b93 tempest-GroupsTest-370172451 None] Group tempest-GroupsTest-Group-397926470: created successfully Sep 08 13:51:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-37dfc14a-19be-43a4-89f3-daac1aa43b93 tempest-GroupsTest-370172451 None] Create group completed successfully. Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Flow 'volume_create_manager' (56875978-fce3-4aaa-ac27-8f7f20ec20fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1806e-a3a2-436c-9534-b0e7d85d81a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1806e-a3a2-436c-9534-b0e7d85d81a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1896574237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ade4541-f1cb-4007-88ec-643e637e7c77,host='devstack@QuobyteHD#QuobyteHD',id=2a742cd9-1210-4a33-9f0d-beee82c07b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d75bf3aab24244a0aec9ed2b499b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:45Z,use_quota=True,user_id='58c884ed3dd0451c8ad65e4dbb4ad119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b60f69c3-3321-4b33-a4f9-32af4e42da40),volume_type_id=b60f69c3-3321-4b33-a4f9-32af4e42da40)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb280f09-dea6-4eb6-b35d-bf78f3d8e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb280f09-dea6-4eb6-b35d-bf78f3d8e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a69d56-04b3-4216-b3c7-0d981ba59373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a69d56-04b3-4216-b3c7-0d981ba59373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a742cd9-1210-4a33-9f0d-beee82c07b30', 'volume_name': 'volume-2a742cd9-1210-4a33-9f0d-beee82c07b30', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0cf5ba-ce76-4744-9f9c-37358fb7ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0cf5ba-ce76-4744-9f9c-37358fb7ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc35fd2b-3381-4046-94a2-37443574d563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:44 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Volume 2a742cd9-1210-4a33-9f0d-beee82c07b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a742cd9-1210-4a33-9f0d-beee82c07b30', 'volume_size': 1} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ade4541-f1cb-4007-88ec-643e637e7c77,created_at=2026-09-08T11:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1896574237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ade4541-f1cb-4007-88ec-643e637e7c77,host='devstack@QuobyteHD#QuobyteHD',id=2a742cd9-1210-4a33-9f0d-beee82c07b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d75bf3aab24244a0aec9ed2b499b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:45Z,use_quota=True,user_id='58c884ed3dd0451c8ad65e4dbb4ad119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b60f69c3-3321-4b33-a4f9-32af4e42da40),volume_type_id=b60f69c3-3321-4b33-a4f9-32af4e42da40)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Creating volume 2a742cd9-1210-4a33-9f0d-beee82c07b30 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:51:44 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:51:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:44 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 1073741824 Sep 08 13:51:44 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:45 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 1073741824" returned: 0 in 0.593s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:45 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 Sep 08 13:51:45 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:45 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30" returned: 0 in 0.263s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc35fd2b-3381-4046-94a2-37443574d563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a742cd9-1210-4a33-9f0d-beee82c07b30', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16f71b6-3a0c-43e3-9f37-4dfc5a62a597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:45 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Volume volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 (2a742cd9-1210-4a33-9f0d-beee82c07b30): created successfully Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16f71b6-3a0c-43e3-9f37-4dfc5a62a597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Flow 'volume_create_manager' (56875978-fce3-4aaa-ac27-8f7f20ec20fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0cf30881-ed41-4a34-9b77-d94607f91174 tempest-GroupsTest-370172451 None] Created volume successfully. Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Flow 'volume_create_manager' (3f21b32d-1a66-4a4c-999f-c9b9c5de5a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee43efc-8ee7-4f24-ac6d-44629441de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee43efc-8ee7-4f24-ac6d-44629441de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1653405239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ade4541-f1cb-4007-88ec-643e637e7c77,host='devstack@QuobyteHD#QuobyteHD',id=6f90878f-a384-4c2e-9a08-e6361b525444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d75bf3aab24244a0aec9ed2b499b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:47Z,use_quota=True,user_id='58c884ed3dd0451c8ad65e4dbb4ad119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b60f69c3-3321-4b33-a4f9-32af4e42da40),volume_type_id=b60f69c3-3321-4b33-a4f9-32af4e42da40)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb463261-9b9a-4afe-baef-7c49236f3a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb463261-9b9a-4afe-baef-7c49236f3a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c345406-7a4d-41ab-8be5-897a53877cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c345406-7a4d-41ab-8be5-897a53877cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f90878f-a384-4c2e-9a08-e6361b525444', 'volume_name': 'volume-6f90878f-a384-4c2e-9a08-e6361b525444', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f687cb1-f4e8-44ca-9f92-d34553cd7003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f687cb1-f4e8-44ca-9f92-d34553cd7003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fcfaa5-5182-4b99-897e-61b67c43a2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:46 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Volume 6f90878f-a384-4c2e-9a08-e6361b525444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f90878f-a384-4c2e-9a08-e6361b525444', 'volume_size': 1} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ade4541-f1cb-4007-88ec-643e637e7c77,created_at=2026-09-08T11:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1653405239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ade4541-f1cb-4007-88ec-643e637e7c77,host='devstack@QuobyteHD#QuobyteHD',id=6f90878f-a384-4c2e-9a08-e6361b525444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d75bf3aab24244a0aec9ed2b499b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:47Z,use_quota=True,user_id='58c884ed3dd0451c8ad65e4dbb4ad119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b60f69c3-3321-4b33-a4f9-32af4e42da40),volume_type_id=b60f69c3-3321-4b33-a4f9-32af4e42da40)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Creating volume 6f90878f-a384-4c2e-9a08-e6361b525444 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:51:46 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:51:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:46 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 1073741824 Sep 08 13:51:46 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:47 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 1073741824" returned: 0 in 0.464s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:47 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 Sep 08 13:51:47 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:47 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fcfaa5-5182-4b99-897e-61b67c43a2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f90878f-a384-4c2e-9a08-e6361b525444', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a409c0c4-1221-4d3f-89bf-f9acbe6ac8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:47 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Volume volume-6f90878f-a384-4c2e-9a08-e6361b525444 (6f90878f-a384-4c2e-9a08-e6361b525444): created successfully Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a409c0c4-1221-4d3f-89bf-f9acbe6ac8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Flow 'volume_create_manager' (3f21b32d-1a66-4a4c-999f-c9b9c5de5a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:47 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-81cad675-b702-4a9e-b1fb-093e9bc231c7 tempest-GroupsTest-370172451 None] Created volume successfully. Sep 08 13:51:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-42b50840-155b-4ab8-8ff5-a5182c478486 tempest-GroupsTest-370172451 None] Update group completed successfully. Sep 08 13:51:49 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8eb40632-ef49-44da-98f8-ce609548506d tempest-GroupsTest-370172451 None] Update group completed successfully. Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Flow 'volume_create_manager' (5360ef9d-120c-4139-96c3-cf7d3af3735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74713ba-237b-48a6-b89a-a0dbe7bc8b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74713ba-237b-48a6-b89a-a0dbe7bc8b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-281460653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054689d8-9659-462f-9fcc-63ee1d9c0965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740ec10301c04af3bc66ff85fd5771f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:51Z,use_quota=True,user_id='96849b97e82347b483eb1db396856403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6920edf0-e02e-457c-8c25-d541532af4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6920edf0-e02e-457c-8c25-d541532af4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2a5579-85c4-40be-b522-b25975c2f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2a5579-85c4-40be-b522-b25975c2f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054689d8-9659-462f-9fcc-63ee1d9c0965', 'volume_name': 'volume-054689d8-9659-462f-9fcc-63ee1d9c0965', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d54e78-581e-4f2a-9a25-600ae0d7bde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d54e78-581e-4f2a-9a25-600ae0d7bde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917f51a2-3631-4f91-894d-a826d12fb90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:51 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Volume 054689d8-9659-462f-9fcc-63ee1d9c0965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054689d8-9659-462f-9fcc-63ee1d9c0965', 'volume_size': 1} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-281460653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054689d8-9659-462f-9fcc-63ee1d9c0965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740ec10301c04af3bc66ff85fd5771f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:51:51Z,use_quota=True,user_id='96849b97e82347b483eb1db396856403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Creating volume 054689d8-9659-462f-9fcc-63ee1d9c0965 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:51:51 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:51 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 1073741824 Sep 08 13:51:51 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:51 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 1073741824" returned: 0 in 0.793s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:52 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 Sep 08 13:51:52 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Acquiring lock "cinder-quobyte-2a742cd9-1210-4a33-9f0d-beee82c07b30" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Lock "cinder-quobyte-2a742cd9-1210-4a33-9f0d-beee82c07b30" acquired by "delete_volume" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee0b2b0-2d7e-4140-af91-fb50b87baa62]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:52 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 Sep 08 13:51:52 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:52 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965" returned: 0 in 0.488s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917f51a2-3631-4f91-894d-a826d12fb90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054689d8-9659-462f-9fcc-63ee1d9c0965', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18df712-849c-4851-80d8-bc30654c95e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:51:52 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Volume volume-054689d8-9659-462f-9fcc-63ee1d9c0965 (054689d8-9659-462f-9fcc-63ee1d9c0965): created successfully Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18df712-849c-4851-80d8-bc30654c95e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Flow 'volume_create_manager' (5360ef9d-120c-4139-96c3-cf7d3af3735e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:51:52 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1cc3a877-8965-4cb3-90c6-6a2c403e0506 tempest-AttachVolumeShelveTestJSON-328826300 None] Created volume successfully. Sep 08 13:51:52 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30" returned: 0 in 0.539s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:52 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30 Sep 08 13:51:52 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:53 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a742cd9-1210-4a33-9f0d-beee82c07b30" returned: 0 in 0.382s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Lock "cinder-quobyte-2a742cd9-1210-4a33-9f0d-beee82c07b30" released by "delete_volume" :: held 0.997s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Acquiring lock "cinder-quobyte-6f90878f-a384-4c2e-9a08-e6361b525444" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:51:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Lock "cinder-quobyte-6f90878f-a384-4c2e-9a08-e6361b525444" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:51:53 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6dc50c-fecf-48db-af20-687a97a0bfdc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:51:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:53 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 Sep 08 13:51:53 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:53 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444" returned: 0 in 0.600s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:53 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444 Sep 08 13:51:53 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:54 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6f90878f-a384-4c2e-9a08-e6361b525444" returned: 0 in 0.456s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Lock "cinder-quobyte-6f90878f-a384-4c2e-9a08-e6361b525444" released by "delete_volume" :: held 1.127s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Created reservations ['aeca206b-c4ec-4077-a7fa-1e1f5e8a3a9e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:54 devstack cinder-volume[87262]: WARNING cinder.quota [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1952881555 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1952881555, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:51:54 devstack cinder-volume[87262]: WARNING cinder.quota [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1952881555 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1952881555, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Created reservations ['c53eeb91-d42f-4bda-bcd7-64bec9e542ab', '08c0009e-433f-4d7a-ac05-a283ac0b977e', '2d775f08-c868-4247-889f-ee5a52c6c98e', '999abf88-f17e-45a2-980e-51038bacb619'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Created reservations ['881d9eaa-ef4e-4006-8f0a-0822e89e67ea', '7f23801d-99a1-4d47-bfb4-d86b8f060d8e', 'dd2d0c15-4e18-4527-b867-3473566375c8', '9185adeb-32ae-4c30-a055-c9de3e610545'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:51:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:51:54 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:51:54 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:51:55 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 08 13:51:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.876s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:51:55 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:51:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c2e84643-48ef-47cf-8c2f-a8e8fca17164 tempest-GroupsTest-370172451 None] Delete group completed successfully. Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:03 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:52:03 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:03 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.703s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:52:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:52:04 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=54,cinder:INSERT=13,cinder:UPDATE=63,cinder:DELETE=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:52:04 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:INSERT=11,cinder:UPDATE=57,cinder:SELECT=52,cinder:DELETE=4 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Flow 'volume_create_manager' (1fbd03da-d8af-40ba-b026-931f1edaab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b87d4a-4e77-451a-8bdf-61adf9004e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b87d4a-4e77-451a-8bdf-61adf9004e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1153659513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce935d5-b055-471c-bed9-7a0743d84569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34dea0eecda942988ac454ef91831ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:11Z,use_quota=True,user_id='e79773c501d94254ac68a756450e060c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e341728b-0b18-4988-9072-f00dd6d978b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e341728b-0b18-4988-9072-f00dd6d978b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0f65c9-a9b1-4301-a62b-17dede08baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0f65c9-a9b1-4301-a62b-17dede08baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce935d5-b055-471c-bed9-7a0743d84569', 'volume_name': 'volume-7ce935d5-b055-471c-bed9-7a0743d84569', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6256f0cd-9f2c-42e0-8a9a-8abc2875a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6256f0cd-9f2c-42e0-8a9a-8abc2875a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cdf4a1-98fa-4408-ba44-2b65369efd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:10 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Volume 7ce935d5-b055-471c-bed9-7a0743d84569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce935d5-b055-471c-bed9-7a0743d84569', 'volume_size': 1} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1153659513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce935d5-b055-471c-bed9-7a0743d84569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34dea0eecda942988ac454ef91831ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:11Z,use_quota=True,user_id='e79773c501d94254ac68a756450e060c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Creating volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:52:11 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:11 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 1073741824 Sep 08 13:52:11 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Flow 'volume_create_manager' (ef962984-b4a8-4b84-b5bd-cf9addb14dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e3dd8b-5ff0-4a9c-a11d-5732332429a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e3dd8b-5ff0-4a9c-a11d-5732332429a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1520725805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d2996b-54d8-4911-85a6-99656fd870e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf1db34c8b24d2bbc6ee89d0d209d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:11Z,use_quota=True,user_id='11b0108c4ac84a939fc175b0b18aa308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73d7422-e9de-4104-8ce2-24fd92554d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73d7422-e9de-4104-8ce2-24fd92554d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3664f8ce-41b2-4fe9-8a3b-5cffcfbf93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3664f8ce-41b2-4fe9-8a3b-5cffcfbf93ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d2996b-54d8-4911-85a6-99656fd870e2', 'volume_name': 'volume-13d2996b-54d8-4911-85a6-99656fd870e2', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2f8085-1b46-4783-bdb6-8552d0b2f3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2f8085-1b46-4783-bdb6-8552d0b2f3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb59d61e-68be-4328-8d38-a57b0500eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:11 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Volume 13d2996b-54d8-4911-85a6-99656fd870e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d2996b-54d8-4911-85a6-99656fd870e2', 'volume_size': 1} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:11 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 1073741824" returned: 0 in 0.898s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Flow 'volume_create_manager' (015b44ad-3858-43b0-ac40-4f6c2e0ec835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa3bb8b-2ea8-4473-a546-bef640495d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa3bb8b-2ea8-4473-a546-bef640495d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-695404014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ad2df6-56c0-4400-a3ec-808a2f4878b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9244d3aee8004718881b6887339758ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:12Z,use_quota=True,user_id='4ab4628d052c47168b1344db52c725a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d54a45-84ef-4cda-aa6f-cd781ca26e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d54a45-84ef-4cda-aa6f-cd781ca26e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:12 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 Sep 08 13:52:12 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9af7fe-9c24-4e91-965c-6fae4c0e2cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9af7fe-9c24-4e91-965c-6fae4c0e2cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24ad2df6-56c0-4400-a3ec-808a2f4878b6', 'volume_name': 'volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93218891-bbf9-4268-ba81-95f9f8e8b4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93218891-bbf9-4268-ba81-95f9f8e8b4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc4e12a-a137-4000-befa-0dee01c9ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Volume 24ad2df6-56c0-4400-a3ec-808a2f4878b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6', 'volume_size': 1} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-bb1e1801-db06-4706-834b-91cb5da8f050 req-673d57c2-bb47-49fd-9109-82b21e774b25 tempest-AttachVolumeShelveTestJSON-328826300 None] No connector for attachment 7d2340c6-c48d-468a-af1c-0f3e9766d131; skipping storage backend terminate_connection call. {{(pid=87262) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-bb1e1801-db06-4706-834b-91cb5da8f050 req-673d57c2-bb47-49fd-9109-82b21e774b25 tempest-AttachVolumeShelveTestJSON-328826300 None] Deleting attachment 7d2340c6-c48d-468a-af1c-0f3e9766d131. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:52:12 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569" returned: 0 in 0.374s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1520725805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d2996b-54d8-4911-85a6-99656fd870e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf1db34c8b24d2bbc6ee89d0d209d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:11Z,use_quota=True,user_id='11b0108c4ac84a939fc175b0b18aa308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Creating volume 13d2996b-54d8-4911-85a6-99656fd870e2 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:52:12 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cdf4a1-98fa-4408-ba44-2b65369efd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce935d5-b055-471c-bed9-7a0743d84569', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:12 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 1073741824 Sep 08 13:52:12 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a43ebc6-6992-4400-a0e4-2ac6e99e04c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Volume volume-7ce935d5-b055-471c-bed9-7a0743d84569 (7ce935d5-b055-471c-bed9-7a0743d84569): created successfully Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a43ebc6-6992-4400-a0e4-2ac6e99e04c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Flow 'volume_create_manager' (1fbd03da-d8af-40ba-b026-931f1edaab0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:12 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0c3ab716-7fd5-48cc-8a74-f77512a54da6 tempest-SnapshotsActionsTest-1962116845 None] Created volume successfully. Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:13 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 1073741824" returned: 0 in 0.996s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:13 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 Sep 08 13:52:13 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:13 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2" returned: 0 in 0.269s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-695404014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ad2df6-56c0-4400-a3ec-808a2f4878b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9244d3aee8004718881b6887339758ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:12Z,use_quota=True,user_id='4ab4628d052c47168b1344db52c725a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Creating volume 24ad2df6-56c0-4400-a3ec-808a2f4878b6 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:52:13 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:13 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 1073741824 Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb59d61e-68be-4328-8d38-a57b0500eb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d2996b-54d8-4911-85a6-99656fd870e2', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:13 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea585c6-c37c-444c-a96e-ac32b55bd15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:13 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Volume volume-13d2996b-54d8-4911-85a6-99656fd870e2 (13d2996b-54d8-4911-85a6-99656fd870e2): created successfully Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea585c6-c37c-444c-a96e-ac32b55bd15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Flow 'volume_create_manager' (ef962984-b4a8-4b84-b5bd-cf9addb14dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d4d01c31-326c-44fd-a9d8-f466ea6c5c00 tempest-ServerRescueNegativeTestJSON-1386564622 None] Created volume successfully. Sep 08 13:52:14 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 1073741824" returned: 0 in 1.166s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:15 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 Sep 08 13:52:15 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:15 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6" returned: 0 in 0.483s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.285s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc4e12a-a137-4000-befa-0dee01c9ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66177f74-5bf0-426b-953e-876c86710f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Creating offline snapshot 7bd1d488-acd9-48f3-8b75-83e4995ab0cd of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:52:15 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Volume volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 (24ad2df6-56c0-4400-a3ec-808a2f4878b6): created successfully Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66177f74-5bf0-426b-953e-876c86710f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Flow 'volume_create_manager' (015b44ad-3858-43b0-ac40-4f6c2e0ec835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b071bec-ab72-4045-891b-37251d0277f5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e612a74b-f562-4216-90c0-65f086731268 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Created volume successfully. Sep 08 13:52:15 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 Sep 08 13:52:15 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:16 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569" returned: 0 in 0.628s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:16 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd 1G Sep 08 13:52:16 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:16 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd 1G" returned: 0 in 0.662s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Acquiring lock "cinder-24ad2df6-56c0-4400-a3ec-808a2f4878b6-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:16 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:16 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "cinder-24ad2df6-56c0-4400-a3ec-808a2f4878b6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Acquiring lock "cinder-quobyte-24ad2df6-56c0-4400-a3ec-808a2f4878b6" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "cinder-quobyte-24ad2df6-56c0-4400-a3ec-808a2f4878b6" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56bde32-3e07-420c-bd5d-e974a6fe10be]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:17 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 Sep 08 13:52:17 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:17 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.468s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:17 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd is being set with open permissions: ugo+rw Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:17 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:17 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:17 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6" returned: 0 in 0.641s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:17 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6 Sep 08 13:52:17 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:17 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.575s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:18 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.info Sep 08 13:52:18 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:18 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-24ad2df6-56c0-4400-a3ec-808a2f4878b6" returned: 0 in 0.614s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "cinder-quobyte-24ad2df6-56c0-4400-a3ec-808a2f4878b6" released by "delete_volume" :: held 1.318s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Created reservations ['90b6659b-9e4f-4c40-a578-8e8853b80c02', 'a929c857-63e6-428c-9e2c-61b2061f74d8', 'b1c7f602-1368-4adf-a54b-46473e26c6d6', '451e3fdf-91fc-41d3-81b9-0f9435668737'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:18 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.info" returned: 0 in 0.583s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:18 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.info is being set with open permissions: ugo+rw Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:18 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.info Sep 08 13:52:18 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:18 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:52:18 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:19 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.info" returned: 0 in 0.415s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.571s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-adfe54ab-3a22-41f6-a94b-dcf6d3eec185 tempest-SnapshotsActionsTest-1962116845 None] Create snapshot completed successfully Sep 08 13:52:19 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.584s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:19 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:52:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Deleted volume successfully. Sep 08 13:52:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4d7d796b-28f3-476d-9619-861dc2367a50 tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "cinder-24ad2df6-56c0-4400-a3ec-808a2f4878b6-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Flow 'volume_create_manager' (142a5b4a-dd10-41bb-8837-528811fcfef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f5063f-a5a7-4686-8f44-d8b34a825c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f5063f-a5a7-4686-8f44-d8b34a825c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1544969135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebea3921-068f-405a-bfe2-ac8b3bc1f4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9244d3aee8004718881b6887339758ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:21Z,use_quota=True,user_id='4ab4628d052c47168b1344db52c725a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b69fa2b-a747-4d42-a82e-174f4bda69ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b69fa2b-a747-4d42-a82e-174f4bda69ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e926fb-cd43-454b-b310-1d24f3d119ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e926fb-cd43-454b-b310-1d24f3d119ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebea3921-068f-405a-bfe2-ac8b3bc1f4c0', 'volume_name': 'volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc923b31-5768-4830-864a-183066f7354e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc923b31-5768-4830-864a-183066f7354e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352e1800-c249-40e5-b11a-0d603c260e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Volume ebea3921-068f-405a-bfe2-ac8b3bc1f4c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0', 'volume_size': 1} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1544969135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebea3921-068f-405a-bfe2-ac8b3bc1f4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9244d3aee8004718881b6887339758ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:21Z,use_quota=True,user_id='4ab4628d052c47168b1344db52c725a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Creating volume ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:52:20 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:52:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:21 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 1073741824 Sep 08 13:52:21 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:21 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 1073741824" returned: 0 in 1.008s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:22 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 Sep 08 13:52:22 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:22 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0" returned: 0 in 0.500s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.562s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Creating offline snapshot d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352e1800-c249-40e5-b11a-0d603c260e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88939722-358a-431c-a4f0-e32590489c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[04237a7b-8e56-4c0b-b5ad-355183eb7f22]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:22 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Volume volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 (ebea3921-068f-405a-bfe2-ac8b3bc1f4c0): created successfully Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88939722-358a-431c-a4f0-e32590489c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Flow 'volume_create_manager' (142a5b4a-dd10-41bb-8837-528811fcfef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3bfb4846-e607-4350-b367-5e9906caeada tempest-VolumeQuotasAdminTestJSON-1094167846 None] Created volume successfully. Sep 08 13:52:23 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:23 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:23 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.656s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:23 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb 1G Sep 08 13:52:23 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:24 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb 1G" returned: 0 in 0.616s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:24 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb Sep 08 13:52:24 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:24 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb" returned: 0 in 0.432s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:24 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb is being set with open permissions: ugo+rw Sep 08 13:52:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:24 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb Sep 08 13:52:24 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:24 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb" returned: 0 in 0.483s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-14f0a6ae-2b6d-4f55-b7ad-8ccd3403951e tempest-VolumeQuotasAdminTestJSON-1914877220 None] Transfer volume completed successfully. Sep 08 13:52:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5170a437-f2e1-4154-891a-aae3367350db tempest-SnapshotsActionsTest-1962116845 None] Create snapshot completed successfully Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-quobyte-d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Deleting offline snapshot d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] snapshot_file for this snap is: volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbc7414-ddec-4007-9b25-31824e96a056]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Acquiring lock "cinder-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Lock "cinder-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Acquiring lock "cinder-quobyte-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:26 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Lock "cinder-quobyte-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:26 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2d5ffc-2425-4dba-b82f-f302b6317b6e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:26 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 Sep 08 13:52:26 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:26 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb" returned: 0 in 0.658s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd80e77-b032-4e35-bd6b-a2681785ceeb]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:26 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0" returned: 0 in 0.719s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:26 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:26 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:26 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0 Sep 08 13:52:26 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:27 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0" returned: 0 in 0.685s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Lock "cinder-quobyte-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0" released by "delete_volume" :: held 1.496s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:27 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 1.085s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:27 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb Sep 08 13:52:27 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:27 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Created reservations ['02d15698-b747-492c-8bc6-d9f5c13db345', '290172d0-72c0-4952-b372-b969858b38fd', 'fbef9711-4b90-42e8-952a-e0a30fdca78c', '33938904-6832-4197-bbe8-028264abaea9'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Acquiring lock "cinder-13d2996b-54d8-4911-85a6-99656fd870e2-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "cinder-13d2996b-54d8-4911-85a6-99656fd870e2-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:28 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:52:28 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Acquiring lock "cinder-quobyte-13d2996b-54d8-4911-85a6-99656fd870e2" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "cinder-quobyte-13d2996b-54d8-4911-85a6-99656fd870e2" acquired by "delete_volume" :: waited 0.036s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70035ad-8fe8-476b-a742-e566208ae838]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:28 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 Sep 08 13:52:28 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:29 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 1.174s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:29 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:52:29 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:29 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Deleted volume successfully. Sep 08 13:52:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb" returned: 0 in 1.583s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:29 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb Sep 08 13:52:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed99bfca-b157-4f38-964f-f60f4e81eeba tempest-VolumeQuotasAdminTestJSON-1929661092 None] Lock "cinder-ebea3921-068f-405a-bfe2-ac8b3bc1f4c0-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:29 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:29 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2" returned: 0 in 1.435s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:30 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2 Sep 08 13:52:30 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:30 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb" returned: 0 in 0.893s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb" released by "_delete_snapshot" :: held 4.489s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" released by "delete_snapshot" :: held 4.568s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Created reservations ['696e2df8-8f5e-40bd-8036-ec16d0fc060a', '0a11cabf-bf08-472a-8d75-d2b1c091436c', 'dea1a313-1e1c-4867-b612-ea45b9eed9ac', '97d0638b-57d5-4e32-819f-e56b3ee48516'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:30 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13d2996b-54d8-4911-85a6-99656fd870e2" returned: 0 in 0.958s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "cinder-quobyte-13d2996b-54d8-4911-85a6-99656fd870e2" released by "delete_volume" :: held 2.601s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Delete snapshot completed successfully. Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4e96060-a051-489d-ac34-9578a4521d11 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-d85d4ed9-d99f-43c5-ba7a-adb9d395a8fb-delete_snapshot" released by "delete_snapshot" :: held 5.210s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Created reservations ['8581c28c-d89b-4864-9e44-cdcc019e32ef', 'f91f0ade-b700-47f9-b5bd-37a83b4b5d2c', '4eda4547-d99f-4689-b0b9-7df2e84ccf85', '78eb1970-101a-4e79-8883-4b6d46dfcd50'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:31 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:52:31 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:31 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.649s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:31 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:52:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Deleted volume successfully. Sep 08 13:52:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cfdb2b55-3173-437d-adae-c21ff40dba88 tempest-ServerRescueNegativeTestJSON-1386564622 None] Lock "cinder-13d2996b-54d8-4911-85a6-99656fd870e2-delete_volume" released by "delete_volume" :: held 4.080s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Creating offline snapshot 6728a51d-fa96-42a3-88be-40f96418e930 of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:52:33 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d6a23b-fd64-4a02-8f5b-d58cb9e6c633]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:33 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:33 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:33 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.741s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:34 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 1G Sep 08 13:52:34 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:34 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 1G" returned: 0 in 0.961s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:34 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 Sep 08 13:52:34 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:35 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930" returned: 0 in 0.551s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:35 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 is being set with open permissions: ugo+rw Sep 08 13:52:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:35 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 Sep 08 13:52:35 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:35 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930" returned: 0 in 0.498s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.195s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-315d1bd6-417e-49c1-891e-248bd2f949ec tempest-SnapshotsActionsTest-1962116845 None] Create snapshot completed successfully Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-6728a51d-fa96-42a3-88be-40f96418e930-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-6728a51d-fa96-42a3-88be-40f96418e930-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-quobyte-6728a51d-fa96-42a3-88be-40f96418e930" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-6728a51d-fa96-42a3-88be-40f96418e930" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Deleting offline snapshot 6728a51d-fa96-42a3-88be-40f96418e930 of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] snapshot_file for this snap is: volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[774229b6-311d-4ac4-b34a-82aef0771c9e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:37 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 Sep 08 13:52:37 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:38 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930" returned: 0 in 0.590s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[82367794-4d94-45bd-a59e-9be1d070f2e8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:38 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:38 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:39 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.704s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:39 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 Sep 08 13:52:39 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:39 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930" returned: 0 in 0.637s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:39 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930 Sep 08 13:52:39 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:39 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.6728a51d-fa96-42a3-88be-40f96418e930" returned: 0 in 0.313s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-6728a51d-fa96-42a3-88be-40f96418e930" released by "_delete_snapshot" :: held 2.448s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" released by "delete_snapshot" :: held 2.518s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:40 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Created reservations ['59f10cd9-78a9-4ca9-b85f-a8908e4c85d8', '876d49c3-7181-4564-b440-b15b73fa45da', '31bee8ad-df89-4585-88df-393dc2a7c697', '923f9944-b9c8-46d7-9a09-3a717c54b5dd'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Delete snapshot completed successfully. Sep 08 13:52:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c8c570fc-3dec-4ba2-b812-33bb8da8ef12 tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-6728a51d-fa96-42a3-88be-40f96418e930-delete_snapshot" released by "delete_snapshot" :: held 2.770s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Creating offline snapshot cadc298a-0033-4648-8c5f-10379c90c1a1 of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:52:41 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f0062c-5134-46df-912d-9d8adebc8262]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:41 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:41 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:41 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.535s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:42 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 1G Sep 08 13:52:42 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:42 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 1G" returned: 0 in 0.612s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:42 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 Sep 08 13:52:42 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:42 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1" returned: 0 in 0.323s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:42 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 is being set with open permissions: ugo+rw Sep 08 13:52:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:42 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 Sep 08 13:52:42 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:43 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1" returned: 0 in 0.286s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:43 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5af812ee-9c5a-44d6-bde5-5772c7d0d8ac tempest-SnapshotsActionsTest-1962116845 None] Create snapshot completed successfully Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-cadc298a-0033-4648-8c5f-10379c90c1a1-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-cadc298a-0033-4648-8c5f-10379c90c1a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-quobyte-cadc298a-0033-4648-8c5f-10379c90c1a1" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-cadc298a-0033-4648-8c5f-10379c90c1a1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Deleting offline snapshot cadc298a-0033-4648-8c5f-10379c90c1a1 of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] snapshot_file for this snap is: volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b84efb-2e06-47de-8e02-cc7ef1892875]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:43 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 Sep 08 13:52:43 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:44 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1" returned: 0 in 0.477s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:44 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[99329e8a-15ee-476f-8011-26f62eb53ca9]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:44 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:44 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:44 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.499s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:44 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 Sep 08 13:52:44 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Flow 'volume_create_manager' (9a90e812-25a1-47b0-9266-12468ee5912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa96ded5-f2cb-43d1-8c7a-9f41ea96a2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa96ded5-f2cb-43d1-8c7a-9f41ea96a2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1142891058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f334b24-2a7a-4e62-9b06-cf6ca9d1a093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9da888e4b474a9fa145dfb1da7f0a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:45Z,use_quota=True,user_id='81a328343c7a49d293af6bf5cd058137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91020ef3-1c29-4051-a583-f6d7af035391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91020ef3-1c29-4051-a583-f6d7af035391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf0946f-aa30-4900-9641-cbdcedda1f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf0946f-aa30-4900-9641-cbdcedda1f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f334b24-2a7a-4e62-9b06-cf6ca9d1a093', 'volume_name': 'volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68d3545-9327-437a-a950-43e9f57e6f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68d3545-9327-437a-a950-43e9f57e6f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3057f083-4cb9-4889-aac2-4277777f3d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:45 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Volume 8f334b24-2a7a-4e62-9b06-cf6ca9d1a093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093', 'volume_size': 1} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1142891058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f334b24-2a7a-4e62-9b06-cf6ca9d1a093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9da888e4b474a9fa145dfb1da7f0a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:45Z,use_quota=True,user_id='81a328343c7a49d293af6bf5cd058137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Creating volume 8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:52:45 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:45 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 1073741824 Sep 08 13:52:45 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:45 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1" returned: 0 in 0.673s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:45 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1 Sep 08 13:52:45 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:45 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 1073741824" returned: 0 in 0.481s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:45 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 Sep 08 13:52:45 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:45 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.cadc298a-0033-4648-8c5f-10379c90c1a1" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-cadc298a-0033-4648-8c5f-10379c90c1a1" released by "_delete_snapshot" :: held 2.054s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" released by "delete_snapshot" :: held 2.082s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Created reservations ['3d2ef231-ab04-4dc3-b159-e4e971216097', '4c9845c9-2fef-4859-a8d4-f52485812c41', '76556206-31fd-422a-aa7b-80d9870026d4', 'c4d94bab-6d73-4ac6-b83e-286b9cea3059'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Delete snapshot completed successfully. Sep 08 13:52:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-19ee75bf-f5e1-4f89-a155-07740c62ff9e tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-cadc298a-0033-4648-8c5f-10379c90c1a1-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:45 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093" returned: 0 in 0.342s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:52:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3057f083-4cb9-4889-aac2-4277777f3d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95911cd5-09b3-4036-9143-2fbcb9e0bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:46 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Volume volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 (8f334b24-2a7a-4e62-9b06-cf6ca9d1a093): created successfully Sep 08 13:52:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95911cd5-09b3-4036-9143-2fbcb9e0bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Flow 'volume_create_manager' (9a90e812-25a1-47b0-9266-12468ee5912e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:46 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-870895bd-0693-4ecb-9c2f-368a70d7d1dd tempest-VolumesServicesTestJSON-375198294 None] Created volume successfully. Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Acquiring lock "cinder-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Creating offline snapshot c8279b63-dfa2-44e3-adef-51fa700b7f09 of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Lock "cinder-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b3ceba-431e-4093-8f98-88303c4362fb]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Acquiring lock "cinder-quobyte-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Lock "cinder-quobyte-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d40d0ac-1f13-453f-a37d-6d890e4033ea]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:47 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:47 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:47 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 Sep 08 13:52:47 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:47 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.403s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:47 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 1G Sep 08 13:52:47 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:47 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093" returned: 0 in 0.389s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:47 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093 Sep 08 13:52:47 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:48 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Lock "cinder-quobyte-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093" released by "delete_volume" :: held 0.732s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Created reservations ['7fcfb6de-6b50-4350-b8cf-1254e2e63b10', '7b25ffab-d558-41fd-8b89-5febd873cf47', '41381d72-7794-4a03-90e4-11b44e050f1b', '8205cf63-c462-4ca7-ab06-910ab673bac7'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:48 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 1G" returned: 0 in 0.524s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:48 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 Sep 08 13:52:48 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:48 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:52:48 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:48 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09" returned: 0 in 0.338s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:48 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 is being set with open permissions: ugo+rw Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:48 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.334s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:52:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Deleted volume successfully. Sep 08 13:52:48 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 Sep 08 13:52:48 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cff5d86e-2819-4cdf-aacf-75a2694ccc3e tempest-VolumesServicesTestJSON-375198294 None] Lock "cinder-8f334b24-2a7a-4e62-9b06-cf6ca9d1a093-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:48 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09" returned: 0 in 0.283s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.699s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:49 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-74c16107-2dac-4d02-b832-c31441920cd6 tempest-SnapshotsActionsTest-1962116845 None] Create snapshot completed successfully Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-c8279b63-dfa2-44e3-adef-51fa700b7f09-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-c8279b63-dfa2-44e3-adef-51fa700b7f09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Acquiring lock "cinder-quobyte-c8279b63-dfa2-44e3-adef-51fa700b7f09" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-c8279b63-dfa2-44e3-adef-51fa700b7f09" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Deleting offline snapshot c8279b63-dfa2-44e3-adef-51fa700b7f09 of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] snapshot_file for this snap is: volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0f8985-1cf2-4ee7-8b1c-22df750ad2b3]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:49 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 Sep 08 13:52:49 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:50 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09" returned: 0 in 0.462s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:50 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94caef7-1c2a-4ebc-b87a-9d8419f5945f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:50 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:50 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:50 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.501s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:50 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 Sep 08 13:52:50 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:51 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09" returned: 0 in 0.464s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:51 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09 Sep 08 13:52:51 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:51 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.c8279b63-dfa2-44e3-adef-51fa700b7f09" returned: 0 in 0.287s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-c8279b63-dfa2-44e3-adef-51fa700b7f09" released by "_delete_snapshot" :: held 1.842s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" released by "delete_snapshot" :: held 1.868s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:51 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Created reservations ['de8549c5-96e1-4e69-9d13-fa1d887a112d', 'a74d295a-4ae2-4f30-8b1d-fea3f577d163', '5358c2ce-3cb3-4357-aff6-bbc5d308ffbd', 'eb996025-8519-4c1f-9c52-1e7509a05efa'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Delete snapshot completed successfully. Sep 08 13:52:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4bf1f50d-d280-44a6-9a15-2638ebbbf6ba tempest-SnapshotsActionsTest-2069307130 None] Lock "cinder-c8279b63-dfa2-44e3-adef-51fa700b7f09-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "cinder-7bd1d488-acd9-48f3-8b75-83e4995ab0cd-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-7bd1d488-acd9-48f3-8b75-83e4995ab0cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "cinder-quobyte-7bd1d488-acd9-48f3-8b75-83e4995ab0cd" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-quobyte-7bd1d488-acd9-48f3-8b75-83e4995ab0cd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Deleting offline snapshot 7bd1d488-acd9-48f3-8b75-83e4995ab0cd of volume 7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] snapshot_file for this snap is: volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e13ce9f-16e7-4bf9-abca-22483b2291bd]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:52 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:52 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:52 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.587s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce935d5-b055-471c-bed9-7a0743d84569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4d3191-7520-479c-8682-491f514a9b95]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:53 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 Sep 08 13:52:53 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:53 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569" returned: 0 in 0.494s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:53 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:53 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:53 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.454s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:53 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd Sep 08 13:52:53 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:54 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569.7bd1d488-acd9-48f3-8b75-83e4995ab0cd" returned: 0 in 0.281s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-quobyte-7bd1d488-acd9-48f3-8b75-83e4995ab0cd" released by "_delete_snapshot" :: held 1.969s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" released by "delete_snapshot" :: held 2.000s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:54 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Created reservations ['f1b2e659-3871-470c-b13b-fc1ea3628c27', 'da5ba882-6568-4f0b-a849-b4f905b26213', '66c7adc5-cbb5-4675-be1e-0479e526dd27', 'bb4c34c1-1437-40f8-8704-0a7f5d39db34'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Delete snapshot completed successfully. Sep 08 13:52:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d45a3821-1358-4095-9ef2-7d7759882b0b tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-7bd1d488-acd9-48f3-8b75-83e4995ab0cd-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "cinder-7ce935d5-b055-471c-bed9-7a0743d84569-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-7ce935d5-b055-471c-bed9-7a0743d84569-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" acquired by "delete_volume" :: waited 0.036s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:55 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acb3d4c-3d14-450f-82b3-e9964458fb40]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:56 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 Sep 08 13:52:56 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:56 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569" returned: 0 in 0.769s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:56 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569 Sep 08 13:52:56 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Flow 'volume_create_manager' (fbcf2ab7-08e6-4ca7-a464-622678809f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6addec91-0c40-4ff0-aee6-9f41b9015801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6addec91-0c40-4ff0-aee6-9f41b9015801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1188203018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3397a2c-ad49-4227-b8b5-9b108ceeff39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db83c07ed004f3db98d4fa33e6f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:57Z,use_quota=True,user_id='289e5fa2e8c945c194e392eb96c6e8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49786e1e-850d-45fa-99df-ddc75e34b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49786e1e-850d-45fa-99df-ddc75e34b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b01d13-7cfc-487a-a047-66377d3ac5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b01d13-7cfc-487a-a047-66377d3ac5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3397a2c-ad49-4227-b8b5-9b108ceeff39', 'volume_name': 'volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935a6751-aa05-4dc0-b467-ecfb073f8393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935a6751-aa05-4dc0-b467-ecfb073f8393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76d2632-3d3a-4ecb-885f-6324a1062381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:56 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Volume d3397a2c-ad49-4227-b8b5-9b108ceeff39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39', 'volume_size': 1} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1188203018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3397a2c-ad49-4227-b8b5-9b108ceeff39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db83c07ed004f3db98d4fa33e6f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:52:57Z,use_quota=True,user_id='289e5fa2e8c945c194e392eb96c6e8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Creating volume d3397a2c-ad49-4227-b8b5-9b108ceeff39 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:52:57 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:57 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7ce935d5-b055-471c-bed9-7a0743d84569" returned: 0 in 0.387s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:57 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 1073741824 Sep 08 13:52:57 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-quobyte-7ce935d5-b055-471c-bed9-7a0743d84569" released by "delete_volume" :: held 1.275s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Created reservations ['24a62bb9-e5a2-442f-8f59-9956b1bbf8e9', '9ae3cf64-b9ce-431a-a49a-05e21163f6ed', '8d512ec8-a9b8-4a01-a627-1b5c1da4aeb9', '2cfc9965-dcf0-46ee-9276-8ca166a86fdb'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:57 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:52:57 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:57 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.390s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:52:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Deleted volume successfully. Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05202901-dde7-4f8e-acd7-c11de1372e94 tempest-SnapshotsActionsTest-1962116845 None] Lock "cinder-7ce935d5-b055-471c-bed9-7a0743d84569-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:52:57 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 1073741824" returned: 0 in 0.706s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:57 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 Sep 08 13:52:57 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:58 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 08 13:52:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39" returned: 0 in 0.355s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:52:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:52:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:52:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76d2632-3d3a-4ecb-885f-6324a1062381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb04aed2-7f39-46f2-8cdc-33fedaf51a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:52:58 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Volume volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 (d3397a2c-ad49-4227-b8b5-9b108ceeff39): created successfully Sep 08 13:52:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb04aed2-7f39-46f2-8cdc-33fedaf51a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:52:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Flow 'volume_create_manager' (fbcf2ab7-08e6-4ca7-a464-622678809f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:52:58 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3e55ed04-3432-479a-a6d3-552bec49d5b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Created volume successfully. Sep 08 13:52:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:52:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:52:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Creating offline snapshot cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 of volume d3397a2c-ad49-4227-b8b5-9b108ceeff39 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:52:59 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[842c9ffa-8fbe-4b19-a3d6-ab9148081642]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:52:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:52:59 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 Sep 08 13:52:59 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:52:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Acquiring lock "cinder-054689d8-9659-462f-9fcc-63ee1d9c0965-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:52:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "cinder-054689d8-9659-462f-9fcc-63ee1d9c0965-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:52:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Acquiring lock "cinder-quobyte-054689d8-9659-462f-9fcc-63ee1d9c0965" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "cinder-quobyte-054689d8-9659-462f-9fcc-63ee1d9c0965" acquired by "delete_volume" :: waited 0.039s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:00 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39" returned: 0 in 0.564s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace4a59-7418-490f-8864-b85b95986fea]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:00 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 1G Sep 08 13:53:00 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:00 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 Sep 08 13:53:00 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:00 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965" returned: 0 in 0.570s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:00 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965 Sep 08 13:53:00 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:00 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 1G" returned: 0 in 0.670s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:00 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 Sep 08 13:53:00 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:00 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-054689d8-9659-462f-9fcc-63ee1d9c0965" returned: 0 in 0.354s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "cinder-quobyte-054689d8-9659-462f-9fcc-63ee1d9c0965" released by "delete_volume" :: held 1.018s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Created reservations ['3fb04cb8-cd5f-43b8-a64b-7183e0e6b132', '3102c8ba-7a60-4763-b236-6fd4f2a44a33', '59adcd22-db9a-4283-b1aa-b5d501108587', '382c6c5f-3892-48e5-af22-aeea1bf41962'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:01 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4" returned: 0 in 0.500s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:01 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 is being set with open permissions: ugo+rw Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:01 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:01 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:01 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:01 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:01 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4" returned: 0 in 0.369s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:01 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.345s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Deleted volume successfully. Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1dca5600-7922-4c6b-b897-bbf8ab248767 tempest-AttachVolumeShelveTestJSON-328826300 None] Lock "cinder-054689d8-9659-462f-9fcc-63ee1d9c0965-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:01 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.info Sep 08 13:53:01 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:01 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.info" returned: 0 in 0.318s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:01 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.info is being set with open permissions: ugo+rw Sep 08 13:53:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:02 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.info Sep 08 13:53:02 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:02 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.info" returned: 0 in 0.351s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.935s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:02 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0a836265-d9e7-4f6a-88dc-7e075abbeca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Create snapshot completed successfully Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:03 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:03 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "cinder-cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "cinder-quobyte-d3397a2c-ad49-4227-b8b5-9b108ceeff39" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-quobyte-d3397a2c-ad49-4227-b8b5-9b108ceeff39" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "cinder-quobyte-cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-quobyte-cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Deleting offline snapshot cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 of volume d3397a2c-ad49-4227-b8b5-9b108ceeff39 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] snapshot_file for this snap is: volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a877e7-c499-434a-a587-7b0b73bebb30]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:03 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.448s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:53:03 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 Sep 08 13:53:03 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:03 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4" returned: 0 in 0.486s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:53:04 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5409b701-7f78-40d4-98f7-8ecafab9af84]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:04 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 Sep 08 13:53:04 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:04 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39" returned: 0 in 0.485s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:04 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 Sep 08 13:53:04 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:04 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4" returned: 0 in 0.453s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:04 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4 Sep 08 13:53:04 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:05 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39.cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4" returned: 0 in 0.375s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:05 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=90,cinder:UPDATE=100,cinder:DELETE=7,cinder:INSERT=23 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:53:05 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=101,cinder:SELECT=80,cinder:INSERT=29,cinder:DELETE=11 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:53:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-quobyte-cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4" released by "_delete_snapshot" :: held 1.966s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-quobyte-d3397a2c-ad49-4227-b8b5-9b108ceeff39" released by "delete_snapshot" :: held 2.018s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:05 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Created reservations ['f85e4f63-e46c-42d5-9679-7623ae4bb3eb', '82c9309f-2b00-4283-a7cf-eb7e3784190c', 'aec72809-4fd0-438e-ba0d-0906261ba726', 'e6bdaebf-e4ff-41e8-8fe2-92b91ca1fdef'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Delete snapshot completed successfully. Sep 08 13:53:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82272adb-df06-471f-8d88-343cb1315e2b tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-cea1ddbf-4d23-4ffc-a8d0-db09b2d5fbd4-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "cinder-d3397a2c-ad49-4227-b8b5-9b108ceeff39-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-d3397a2c-ad49-4227-b8b5-9b108ceeff39-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Flow 'volume_create_manager' (221fb926-3e94-434e-9523-e92bcb9392e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead810f7-129a-4c92-aabc-3722f8ef9b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead810f7-129a-4c92-aabc-3722f8ef9b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-214909680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20b9a68-e17c-456e-8b78-8c49f4964c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2378e2babd6b40ef8e38e89779004f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:07Z,use_quota=True,user_id='5ade0603cdf54f26923c7f65276eea92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6933fe1f-98a8-42ee-88ce-5e0499788229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6933fe1f-98a8-42ee-88ce-5e0499788229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e2d245-b2fc-460c-b5b8-cfd21ff39025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e2d245-b2fc-460c-b5b8-cfd21ff39025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20b9a68-e17c-456e-8b78-8c49f4964c62', 'volume_name': 'volume-b20b9a68-e17c-456e-8b78-8c49f4964c62', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c76e62-222d-456c-9746-35cc289dac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c76e62-222d-456c-9746-35cc289dac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fbee3e-989d-4590-9e33-d0aeb9b10ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:06 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Volume b20b9a68-e17c-456e-8b78-8c49f4964c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20b9a68-e17c-456e-8b78-8c49f4964c62', 'volume_size': 1} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-214909680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20b9a68-e17c-456e-8b78-8c49f4964c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2378e2babd6b40ef8e38e89779004f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:07Z,use_quota=True,user_id='5ade0603cdf54f26923c7f65276eea92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Creating volume b20b9a68-e17c-456e-8b78-8c49f4964c62 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:06 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:06 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 1073741824 Sep 08 13:53:06 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "cinder-quobyte-d3397a2c-ad49-4227-b8b5-9b108ceeff39" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-quobyte-d3397a2c-ad49-4227-b8b5-9b108ceeff39" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01d5f47-e2a1-40a2-8772-0cdcb0617a32]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:07 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 Sep 08 13:53:07 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:07 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 1073741824" returned: 0 in 0.486s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:07 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39" returned: 0 in 0.442s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:07 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 Sep 08 13:53:07 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:07 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39 Sep 08 13:53:07 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:07 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d3397a2c-ad49-4227-b8b5-9b108ceeff39" returned: 0 in 0.317s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:07 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62" returned: 0 in 0.361s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-quobyte-d3397a2c-ad49-4227-b8b5-9b108ceeff39" released by "delete_volume" :: held 0.852s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fbee3e-989d-4590-9e33-d0aeb9b10ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20b9a68-e17c-456e-8b78-8c49f4964c62', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c444ee23-0776-4a81-be8a-a34c5ab5a912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:07 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Volume volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 (b20b9a68-e17c-456e-8b78-8c49f4964c62): created successfully Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c444ee23-0776-4a81-be8a-a34c5ab5a912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Flow 'volume_create_manager' (221fb926-3e94-434e-9523-e92bcb9392e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:07 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ffa6ffdd-732f-42cb-bcaf-bed83d831103 tempest-VolumesMetadataTest-1927526026 None] Created volume successfully. Sep 08 13:53:07 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Created reservations ['17ceeeda-7d91-4834-89bc-a4ae77b09f0b', '1d2ec81e-ee21-4929-9b67-760b75048935', 'c866bcdd-680b-411d-9513-be25285066b5', '51ff5428-100f-40c9-9d1e-e117c0f45a75'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:08 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:08 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:08 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.293s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Deleted volume successfully. Sep 08 13:53:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ad91a6ba-ec86-4f2a-9ecb-1bd9eb9abf72 tempest-VolumeSnapshotQuotasNegativeTestJSON-530932781 None] Lock "cinder-d3397a2c-ad49-4227-b8b5-9b108ceeff39-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Acquiring lock "cinder-b20b9a68-e17c-456e-8b78-8c49f4964c62-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Lock "cinder-b20b9a68-e17c-456e-8b78-8c49f4964c62-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Acquiring lock "cinder-quobyte-b20b9a68-e17c-456e-8b78-8c49f4964c62" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Lock "cinder-quobyte-b20b9a68-e17c-456e-8b78-8c49f4964c62" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:10 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e263b632-1259-41c3-9951-5df4da4c7cab]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:10 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 Sep 08 13:53:10 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:10 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62" returned: 0 in 0.441s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:10 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62 Sep 08 13:53:10 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:11 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b20b9a68-e17c-456e-8b78-8c49f4964c62" returned: 0 in 0.333s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Lock "cinder-quobyte-b20b9a68-e17c-456e-8b78-8c49f4964c62" released by "delete_volume" :: held 0.847s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Created reservations ['317d7de8-afb1-4aee-8deb-5b265ddfb41f', '181d6d9a-802c-4a3d-b050-084f5d889c00', 'c045945d-98e8-4842-9179-d7b38c924d5c', 'd7f0860d-4c74-422e-baef-501552c8f1d4'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:11 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:11 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:11 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.336s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Deleted volume successfully. Sep 08 13:53:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01f8583d-a060-4cdb-bf03-f6e228e96e0d tempest-VolumesMetadataTest-1927526026 None] Lock "cinder-b20b9a68-e17c-456e-8b78-8c49f4964c62-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Flow 'volume_create_manager' (8e72f637-5841-4807-b777-d5296ed67056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a1ce8a-27e7-40b0-ba15-3af5b7e09f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a1ce8a-27e7-40b0-ba15-3af5b7e09f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-987814670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2e098d-e200-475e-a346-a2db1c263e7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18d5b6b98c1e445b9fee6c2fe096a4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:13Z,use_quota=True,user_id='1d0fbf8595a449629378ab43266eb481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2cf6ee-ab6e-4879-9fd4-02a7e1cc7b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2cf6ee-ab6e-4879-9fd4-02a7e1cc7b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5661b7e2-3a96-4f7d-a6ca-442ebe41ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5661b7e2-3a96-4f7d-a6ca-442ebe41ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2e098d-e200-475e-a346-a2db1c263e7c', 'volume_name': 'volume-fe2e098d-e200-475e-a346-a2db1c263e7c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddc2bd7-16b2-4524-9088-759e5418c668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddc2bd7-16b2-4524-9088-759e5418c668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e062158-f1fe-41a9-b75e-47c07663aeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Volume fe2e098d-e200-475e-a346-a2db1c263e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2e098d-e200-475e-a346-a2db1c263e7c', 'volume_size': 1} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-987814670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2e098d-e200-475e-a346-a2db1c263e7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18d5b6b98c1e445b9fee6c2fe096a4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:13Z,use_quota=True,user_id='1d0fbf8595a449629378ab43266eb481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Creating volume fe2e098d-e200-475e-a346-a2db1c263e7c {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:12 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:12 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c 1073741824 Sep 08 13:53:12 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:13 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c 1073741824" returned: 0 in 0.546s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:13 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c Sep 08 13:53:13 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:13 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c" returned: 0 in 0.314s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e062158-f1fe-41a9-b75e-47c07663aeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2e098d-e200-475e-a346-a2db1c263e7c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c31e52-0e9c-4e75-8184-1998b6edb75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:13 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Volume volume-fe2e098d-e200-475e-a346-a2db1c263e7c (fe2e098d-e200-475e-a346-a2db1c263e7c): created successfully Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c31e52-0e9c-4e75-8184-1998b6edb75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Flow 'volume_create_manager' (8e72f637-5841-4807-b777-d5296ed67056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-ec478272-e7af-4476-bdbe-85bdd9f92ff9 req-e3d60fde-b47e-4e2b-8415-f671eb7b6ead tempest-VolumesGetTestJSON-1267225149 None] Created volume successfully. Sep 08 13:53:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Acquiring lock "cinder-fe2e098d-e200-475e-a346-a2db1c263e7c-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Lock "cinder-fe2e098d-e200-475e-a346-a2db1c263e7c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Acquiring lock "cinder-quobyte-fe2e098d-e200-475e-a346-a2db1c263e7c" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Lock "cinder-quobyte-fe2e098d-e200-475e-a346-a2db1c263e7c" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e2ac74-7557-4ab9-816b-3c51f7e43498]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:15 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c Sep 08 13:53:15 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:16 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c" returned: 0 in 0.418s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:16 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c Sep 08 13:53:16 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:16 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fe2e098d-e200-475e-a346-a2db1c263e7c" returned: 0 in 0.279s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Lock "cinder-quobyte-fe2e098d-e200-475e-a346-a2db1c263e7c" released by "delete_volume" :: held 0.748s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG cinder.quota [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Created reservations ['5ffa1b31-7eb5-4d9a-ae79-d4bac039baa5', '7c065002-2fba-4918-a213-4470b87375a2', '44fe1ddf-c41a-41df-b5a7-3594ba3650ba', '529c6724-9c93-4997-a330-4fec2a3939c8'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:16 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:16 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:16 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.272s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG cinder.manager [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:16 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Deleted volume successfully. Sep 08 13:53:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-f1dc8829-c60f-4272-ae62-2526b4550527 req-e6f366e4-183a-4ad2-8e19-b08f8ac67258 tempest-VolumesGetTestJSON-1267225149 None] Lock "cinder-fe2e098d-e200-475e-a346-a2db1c263e7c-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:19 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Flow 'volume_create_manager' (0e90c130-eed1-4809-bfa0-7e03eacd6a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1f74c7-12eb-42cb-bfd3-5f442f58f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1f74c7-12eb-42cb-bfd3-5f442f58f81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1411295974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8924d8d8-97c4-47e3-842c-75a3f6793975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a780b29f192844eda4876da5022975d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:19Z,use_quota=True,user_id='733dd3e60bb847a29944eee744cb68fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b930856f-3f3c-436a-b150-9891c11a8261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b930856f-3f3c-436a-b150-9891c11a8261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37ceec4-43c1-4b0c-88ed-0c58d4b901b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:19 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Flow 'volume_create_manager' (a61babc5-a65d-4c31-9494-2732d50ed65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e76d95e-d541-4660-b7e9-af6f00ca992f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e76d95e-d541-4660-b7e9-af6f00ca992f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-74540326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f56a026-22aa-43fa-863c-60cb331a1771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bdc6584feb444b865fb3f3a6b6e654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:20Z,use_quota=True,user_id='63b1ac9f8f7a4c0a999ed6ed5724f6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4a30b67-f5da-43a5-9852-001956639f31),volume_type_id=c4a30b67-f5da-43a5-9852-001956639f31)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0955df30-be1c-4657-9c51-afe3f38651a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0955df30-be1c-4657-9c51-afe3f38651a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4699125f-4f1e-4bb4-b786-73febb472e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4699125f-4f1e-4bb4-b786-73febb472e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f56a026-22aa-43fa-863c-60cb331a1771', 'volume_name': 'volume-3f56a026-22aa-43fa-863c-60cb331a1771', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f5bcb6-e21d-4ecb-b262-0c2d28171150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f5bcb6-e21d-4ecb-b262-0c2d28171150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af5f8d5-5de7-4c15-a9c1-104ada9676d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Volume 3f56a026-22aa-43fa-863c-60cb331a1771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f56a026-22aa-43fa-863c-60cb331a1771', 'volume_size': 1} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-74540326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f56a026-22aa-43fa-863c-60cb331a1771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bdc6584feb444b865fb3f3a6b6e654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:20Z,use_quota=True,user_id='63b1ac9f8f7a4c0a999ed6ed5724f6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4a30b67-f5da-43a5-9852-001956639f31),volume_type_id=c4a30b67-f5da-43a5-9852-001956639f31)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Creating volume 3f56a026-22aa-43fa-863c-60cb331a1771 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:20 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:20 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 1073741824 Sep 08 13:53:20 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37ceec4-43c1-4b0c-88ed-0c58d4b901b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8924d8d8-97c4-47e3-842c-75a3f6793975', 'volume_name': 'volume-8924d8d8-97c4-47e3-842c-75a3f6793975', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c980b1d-9cec-4a6b-84fc-ee5e912d5a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c980b1d-9cec-4a6b-84fc-ee5e912d5a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060be67c-cb33-4efe-a8df-dbce34377275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Volume 8924d8d8-97c4-47e3-842c-75a3f6793975: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8924d8d8-97c4-47e3-842c-75a3f6793975', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Trying to clone 8924d8d8-97c4-47e3-842c-75a3f6793975 from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f at location (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 13:53:20 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Image download 20.69 MB at 20.69 MB/s Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc1c61-3452-446f-afba-c2abb1430ddf]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:20 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 1073741824" returned: 0 in 0.692s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:20 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 Sep 08 13:53:20 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:20 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD Sep 08 13:53:20 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:21 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f is fetched for user 733dd3e60bb847a29944eee744cb68fa. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 13:53:21 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771" returned: 0 in 0.395s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af5f8d5-5de7-4c15-a9c1-104ada9676d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f56a026-22aa-43fa-863c-60cb331a1771', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513e1ef9-1c51-4996-a161-bdaea7a3f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:21 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Volume volume-3f56a026-22aa-43fa-863c-60cb331a1771 (3f56a026-22aa-43fa-863c-60cb331a1771): created successfully Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513e1ef9-1c51-4996-a161-bdaea7a3f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Flow 'volume_create_manager' (a61babc5-a65d-4c31-9494-2732d50ed65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:21 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ef747dfa-1667-4578-baef-90a71dce712b tempest-VolumeTypesAccessTest-538420336 None] Created volume successfully. Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[95422927-e1cb-4c0f-bd4a-cd7bcc0acae0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:21 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD Sep 08 13:53:21 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:21 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1411295974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8924d8d8-97c4-47e3-842c-75a3f6793975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a780b29f192844eda4876da5022975d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:19Z,use_quota=True,user_id='733dd3e60bb847a29944eee744cb68fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Creating volume 8924d8d8-97c4-47e3-842c-75a3f6793975 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:21 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:21 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 1073741824 Sep 08 13:53:21 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Acquiring lock "cinder-3f56a026-22aa-43fa-863c-60cb331a1771-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Lock "cinder-3f56a026-22aa-43fa-863c-60cb331a1771-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Acquiring lock "cinder-quobyte-3f56a026-22aa-43fa-863c-60cb331a1771" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Lock "cinder-quobyte-3f56a026-22aa-43fa-863c-60cb331a1771" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:22 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 1073741824" returned: 0 in 0.624s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[44656a87-5842-4c1b-90f2-d61e468d8d65]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:22 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 Sep 08 13:53:22 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:22 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 Sep 08 13:53:22 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:22 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975" returned: 0 in 0.405s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Attempting download of 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume 8924d8d8-97c4-47e3-842c-75a3f6793975. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 13:53:22 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771" returned: 0 in 0.524s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:23 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771 Sep 08 13:53:23 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ef2595-2121-4ec4-9f26-f6b9b6f9855f]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_tt9ddrj_ {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:23 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_tt9ddrj_ Sep 08 13:53:23 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:23 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f56a026-22aa-43fa-863c-60cb331a1771" returned: 0 in 0.337s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Lock "cinder-quobyte-3f56a026-22aa-43fa-863c-60cb331a1771" released by "delete_volume" :: held 0.922s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:23 devstack cinder-volume[87262]: WARNING cinder.quota [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-355280871 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-355280871, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:53:23 devstack cinder-volume[87262]: WARNING cinder.quota [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-355280871 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-355280871, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:53:23 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Created reservations ['df9501a1-9faa-4d15-b692-e975eaa69637', 'e73d9f48-c730-4c84-9df5-e665f092bb41', '2a8614f7-b89e-4bb7-ac20-80c567049d77', '990dedcd-599d-42bf-a278-4b0e9729e95d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_tt9ddrj_" returned: 0 in 0.420s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_tt9ddrj_ {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:23 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_tt9ddrj_ Sep 08 13:53:23 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:23 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:23 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:23 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_tt9ddrj_" returned: 1 in 0.401s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_tt9ddrj_' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[935a3d26-8f67-4452-9826-3b412efa1540]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:23 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.306s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Deleted volume successfully. Sep 08 13:53:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7178bfa6-ad15-43ab-bbfc-84f46f0cd439 tempest-VolumeTypesAccessTest-538420336 None] Lock "cinder-3f56a026-22aa-43fa-863c-60cb331a1771-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:23 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD Sep 08 13:53:23 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9bfa1b41-1d63-447b-b0af-07f4b0224110 tempest-GroupSnapshotsTest-990695160 None] Group tempest-GroupSnapshotsTest-Group-725696985: creating Sep 08 13:53:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9bfa1b41-1d63-447b-b0af-07f4b0224110 tempest-GroupSnapshotsTest-990695160 None] Group tempest-GroupSnapshotsTest-Group-725696985: created successfully Sep 08 13:53:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9bfa1b41-1d63-447b-b0af-07f4b0224110 tempest-GroupSnapshotsTest-990695160 None] Create group completed successfully. Sep 08 13:53:24 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:24 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f was qcow2, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 13:53:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:24 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 Sep 08 13:53:24 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:25 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Flow 'volume_create_manager' (8ce5cfc0-9edd-480f-bcd3-14040ad01f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5502c3df-551b-4c90-a976-e8bfcbcdf282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5502c3df-551b-4c90-a976-e8bfcbcdf282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1021222035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ecf3b33-be40-470f-bdea-1366e2002cbb,host='devstack@QuobyteHD#QuobyteHD',id=f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec843dbc4f478cb0c07a98bf49ab5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:26Z,use_quota=True,user_id='4780d14742ea444286bec3ee3d06ac17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56e360a7-ef0f-4e10-9381-72c17817dab0),volume_type_id=56e360a7-ef0f-4e10-9381-72c17817dab0)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c12d68-9a3c-4c7a-8406-ffa183ed13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c12d68-9a3c-4c7a-8406-ffa183ed13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15c5905-116d-4643-82ad-18963ca6ed7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15c5905-116d-4643-82ad-18963ca6ed7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80', 'volume_name': 'volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66c2aba-1e93-4cfb-af59-1a8873372bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66c2aba-1e93-4cfb-af59-1a8873372bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb73733-dd32-414a-8552-69296e83dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Volume f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80', 'volume_size': 1} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ecf3b33-be40-470f-bdea-1366e2002cbb,created_at=2026-09-08T11:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1021222035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ecf3b33-be40-470f-bdea-1366e2002cbb,host='devstack@QuobyteHD#QuobyteHD',id=f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec843dbc4f478cb0c07a98bf49ab5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:26Z,use_quota=True,user_id='4780d14742ea444286bec3ee3d06ac17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56e360a7-ef0f-4e10-9381-72c17817dab0),volume_type_id=56e360a7-ef0f-4e10-9381-72c17817dab0)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Creating volume f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:26 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:26 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 1073741824 Sep 08 13:53:26 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:26 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975" returned: 0 in 2.281s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_n_h1wkamdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:53:26 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Converted 112.00 MB image at 49.05 MB/s Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:26 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 1G Sep 08 13:53:26 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:26 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 1073741824" returned: 0 in 0.567s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:26 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 Sep 08 13:53:26 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:26 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 1G" returned: 0 in 0.451s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Downloaded image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume 8924d8d8-97c4-47e3-842c-75a3f6793975 successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f for user 733dd3e60bb847a29944eee744cb68fa is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Marking volume 8924d8d8-97c4-47e3-842c-75a3f6793975 as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Copying metadata from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f to 8924d8d8-97c4-47e3-842c-75a3f6793975. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Creating volume glance metadata for volume 8924d8d8-97c4-47e3-842c-75a3f6793975 backed by image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 13:53:27 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" returned: 0 in 0.404s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb73733-dd32-414a-8552-69296e83dded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1d75cf-17ab-49af-b141-f20223436a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:27 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Volume volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 (f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80): created successfully Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1d75cf-17ab-49af-b141-f20223436a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Flow 'volume_create_manager' (8ce5cfc0-9edd-480f-bcd3-14040ad01f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-041a6aa9-3b7b-4d69-b495-5199f29af71c tempest-GroupSnapshotsTest-990695160 None] Created volume successfully. Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060be67c-cb33-4efe-a8df-dbce34377275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8924d8d8-97c4-47e3-842c-75a3f6793975', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1017198b-98ec-444c-80f8-2c837e0c95b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:27 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Volume volume-8924d8d8-97c4-47e3-842c-75a3f6793975 (8924d8d8-97c4-47e3-842c-75a3f6793975): created successfully Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1017198b-98ec-444c-80f8-2c837e0c95b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Flow 'volume_create_manager' (0e90c130-eed1-4809-bfa0-7e03eacd6a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-15121d9a-e61e-44e2-9f37-175c78879d86 tempest-VolumesExtendTest-1763169399 None] Created volume successfully. Sep 08 13:53:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-75751f9a-20a4-4c6e-8a79-568d401f7a95 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-75751f9a-20a4-4c6e-8a79-568d401f7a95 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:28 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4677ada2-df8a-4af0-bc7e-778910fdf726]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75751f9a-20a4-4c6e-8a79-568d401f7a95 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:28 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 Sep 08 13:53:28 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] GroupSnapshot 1f54f438-d864-4239-b23f-537427eb466c: creating. Sep 08 13:53:28 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75751f9a-20a4-4c6e-8a79-568d401f7a95 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975" returned: 0 in 0.593s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75751f9a-20a4-4c6e-8a79-568d401f7a95 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 2G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Group snapshot 1f54f438-d864-4239-b23f-537427eb466c: creating. {{(pid=87262) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 13:53:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75751f9a-20a4-4c6e-8a79-568d401f7a95 tempest-VolumesExtendTest-1763169399 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 2G" returned: 0 in 0.136s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-75751f9a-20a4-4c6e-8a79-568d401f7a95 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.765s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.114s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Creating offline snapshot b6533bec-a208-4b16-b1ac-272b081eacee of volume f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe19653-ac7a-4e2d-88b5-efa89fb9385a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:29 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-75751f9a-20a4-4c6e-8a79-568d401f7a95 tempest-VolumesExtendTest-1763169399 None] Extend volume completed successfully. Sep 08 13:53:29 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 Sep 08 13:53:29 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:29 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" returned: 0 in 0.436s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:29 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee 1G Sep 08 13:53:29 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "cinder-8924d8d8-97c4-47e3-842c-75a3f6793975-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-8924d8d8-97c4-47e3-842c-75a3f6793975-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "cinder-quobyte-8924d8d8-97c4-47e3-842c-75a3f6793975" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-quobyte-8924d8d8-97c4-47e3-842c-75a3f6793975" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bacfda0-c9c7-47e5-b810-887dcd19a55a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:30 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee 1G" returned: 0 in 0.644s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:30 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee Sep 08 13:53:30 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:30 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 Sep 08 13:53:30 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:30 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975" returned: 0 in 0.559s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:30 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee" returned: 0 in 0.494s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:30 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:53:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:30 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975 Sep 08 13:53:30 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:30 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee Sep 08 13:53:30 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:31 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee" returned: 0 in 0.391s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:31 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8924d8d8-97c4-47e3-842c-75a3f6793975" returned: 0 in 0.475s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-quobyte-8924d8d8-97c4-47e3-842c-75a3f6793975" released by "delete_volume" :: held 1.098s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:31 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.info Sep 08 13:53:31 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Created reservations ['3486edca-98fa-483a-b67a-08834193f6da', 'cc3ff468-7b46-4704-a7b3-b399c0fa2537', '7a3bff0e-e135-45e2-90d4-3810a2d943ca', 'f2858ec1-7027-469a-9d5b-6bcdf0c45ff8'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:31 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:31 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:31 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.info" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:31 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:31 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.info Sep 08 13:53:31 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:31 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Deleted volume successfully. Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a392ad8c-5f4c-4848-ab09-55657f1ea9c9 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-8924d8d8-97c4-47e3-842c-75a3f6793975-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:31 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.info" returned: 0 in 0.358s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.832s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:32 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-67eca07c-cf9c-4bdc-9227-0e1a2f387a01 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 1f54f438-d864-4239-b23f-537427eb466c: created successfully Sep 08 13:53:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-b6533bec-a208-4b16-b1ac-272b081eacee-d436c868-49cb-43d1-9fb0-ea4be5615790" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-b6533bec-a208-4b16-b1ac-272b081eacee-d436c868-49cb-43d1-9fb0-ea4be5615790" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Creating volume d436c868-49cb-43d1-9fb0-ea4be5615790 from snapshot b6533bec-a208-4b16-b1ac-272b081eacee {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-d436c868-49cb-43d1-9fb0-ea4be5615790" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-d436c868-49cb-43d1-9fb0-ea4be5615790" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] snapshot: b6533bec-a208-4b16-b1ac-272b081eacee, volume: d436c868-49cb-43d1-9fb0-ea4be5615790, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Flow 'volume_create_manager' (1f06f465-6ba6-4c0c-a2ee-d04e8f040fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5384876-92d6-4548-b113-e3873a1746fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8ad370-d26f-4165-a0da-2cb610f3277d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5384876-92d6-4548-b113-e3873a1746fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2033735177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e33698-268d-42cc-9f54-59016e70a478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a780b29f192844eda4876da5022975d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:33Z,use_quota=True,user_id='733dd3e60bb847a29944eee744cb68fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25eee41f-7fcc-4aff-ba8c-a25a47f311d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25eee41f-7fcc-4aff-ba8c-a25a47f311d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcff96c7-3c65-4e0f-a39b-0fb3a31bbeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcff96c7-3c65-4e0f-a39b-0fb3a31bbeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e33698-268d-42cc-9f54-59016e70a478', 'volume_name': 'volume-a8e33698-268d-42cc-9f54-59016e70a478', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dab29f7-0225-4a99-9278-38529692d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dab29f7-0225-4a99-9278-38529692d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90931c40-0e18-414f-b99f-cda0f89e6362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:33 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Volume a8e33698-268d-42cc-9f54-59016e70a478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e33698-268d-42cc-9f54-59016e70a478', 'volume_size': 1} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:33 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee Sep 08 13:53:33 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:33 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee" returned: 0 in 0.423s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7dc054-d0e6-44d0-83ce-72c3683a500b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:33 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 Sep 08 13:53:33 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:34 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" returned: 0 in 0.412s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 13:53:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 13:53:34 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 13:53:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:34 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 Sep 08 13:53:34 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Flow 'volume_create_manager' (0e7bebe5-f52e-4ba1-ba89-169fa3179ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04f98d1-460c-4833-a160-2aa6d602b64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04f98d1-460c-4833-a160-2aa6d602b64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-435217676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5219739f-4eb0-4a6f-b0ee-5fea093218f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370e45a44e4ab2ba5f1fd7174c88c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:35Z,use_quota=True,user_id='52db2484b89a4ff8b9f8df7445265575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4da4275-07af-455f-acef-022bec8a9dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4da4275-07af-455f-acef-022bec8a9dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ece606c-3ded-465f-8cec-258cce28521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ece606c-3ded-465f-8cec-258cce28521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5219739f-4eb0-4a6f-b0ee-5fea093218f7', 'volume_name': 'volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe359e4c-2eb5-4390-a493-b46e0dd7c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe359e4c-2eb5-4390-a493-b46e0dd7c210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6b65ee-fb7c-4d5d-8767-ae3054d92b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:35 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Volume 5219739f-4eb0-4a6f-b0ee-5fea093218f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7', 'volume_size': 1} Sep 08 13:53:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:39 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790" returned: 0 in 5.458s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:53:39 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Converted 1024.00 MB image at 187.59 MB/s Sep 08 13:53:39 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:39 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 Sep 08 13:53:39 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Flow 'volume_create_manager' (737d27a1-904f-479e-ab87-9c2bafac8a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197c4837-d575-48b8-b16d-dbe30dd464d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197c4837-d575-48b8-b16d-dbe30dd464d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-30976248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ec485b-9ce4-4699-8320-4ea79aed9d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98256b1c0057478bbbe12572692d1f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:40Z,use_quota=True,user_id='ada42ae5ffa840b194af9209f288a16f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fd0300-8881-42b3-a63a-d7fbe55dcb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fd0300-8881-42b3-a63a-d7fbe55dcb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a53b64-11ca-4f4c-b312-34d9e113ddd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a53b64-11ca-4f4c-b312-34d9e113ddd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ec485b-9ce4-4699-8320-4ea79aed9d1a', 'volume_name': 'volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf6be90-f17c-49c2-9553-9c0805657d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf6be90-f17c-49c2-9553-9c0805657d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e719a0-420e-4f40-be7f-040e1bcd92b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:39 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Volume d8ec485b-9ce4-4699-8320-4ea79aed9d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a', 'volume_size': 1} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:39 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790" returned: 0 in 0.251s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-d436c868-49cb-43d1-9fb0-ea4be5615790" released by "_copy_volume_from_snapshot" :: held 6.690s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-b6533bec-a208-4b16-b1ac-272b081eacee-d436c868-49cb-43d1-9fb0-ea4be5615790" released by "_create_volume_from_snapshot" :: held 6.773s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.821s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.519s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2033735177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e33698-268d-42cc-9f54-59016e70a478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a780b29f192844eda4876da5022975d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:33Z,use_quota=True,user_id='733dd3e60bb847a29944eee744cb68fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Creating volume a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:39 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:39 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 1073741824 Sep 08 13:53:39 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:39 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-00611513-c30c-43ce-b7e9-6a1add9708e7 tempest-GroupSnapshotsTest-990695160 None] Create group from source-snapshot-1f54f438-d864-4239-b23f-537427eb466c completed successfully. Sep 08 13:53:40 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 1073741824" returned: 0 in 0.404s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:40 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 Sep 08 13:53:40 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:40 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478" returned: 0 in 0.241s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.826s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-435217676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5219739f-4eb0-4a6f-b0ee-5fea093218f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370e45a44e4ab2ba5f1fd7174c88c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:35Z,use_quota=True,user_id='52db2484b89a4ff8b9f8df7445265575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Creating volume 5219739f-4eb0-4a6f-b0ee-5fea093218f7 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:40 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:40 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 1073741824 Sep 08 13:53:40 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90931c40-0e18-414f-b99f-cda0f89e6362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e33698-268d-42cc-9f54-59016e70a478', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca433ef9-54b2-4693-8611-098c07467dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:40 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Volume volume-a8e33698-268d-42cc-9f54-59016e70a478 (a8e33698-268d-42cc-9f54-59016e70a478): created successfully Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca433ef9-54b2-4693-8611-098c07467dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Flow 'volume_create_manager' (1f06f465-6ba6-4c0c-a2ee-d04e8f040fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4a709cfb-9c27-4e99-84e5-54a0c42e859e tempest-VolumesExtendTest-1763169399 None] Created volume successfully. Sep 08 13:53:40 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 1073741824" returned: 0 in 0.427s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:41 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 Sep 08 13:53:41 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:41 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7" returned: 0 in 0.286s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.561s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-30976248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ec485b-9ce4-4699-8320-4ea79aed9d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98256b1c0057478bbbe12572692d1f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:40Z,use_quota=True,user_id='ada42ae5ffa840b194af9209f288a16f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Creating volume d8ec485b-9ce4-4699-8320-4ea79aed9d1a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:41 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:41 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a 1073741824 Sep 08 13:53:41 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6b65ee-fb7c-4d5d-8767-ae3054d92b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c486475b-755f-4583-a907-715a2526ab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:41 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Volume volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 (5219739f-4eb0-4a6f-b0ee-5fea093218f7): created successfully Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c486475b-755f-4583-a907-715a2526ab0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Flow 'volume_create_manager' (0e7bebe5-f52e-4ba1-ba89-169fa3179ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6f174dad-391a-4cfd-bb52-f02e1c02d9eb tempest-VolumesListAdminTestJSON-2122415767 None] Created volume successfully. Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-d436c868-49cb-43d1-9fb0-ea4be5615790" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-d436c868-49cb-43d1-9fb0-ea4be5615790" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c7f687-d295-4d3d-ae64-3ab9295956a5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:41 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 Sep 08 13:53:41 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:41 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a 1073741824" returned: 0 in 0.452s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:41 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a Sep 08 13:53:41 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:41 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:41 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790 Sep 08 13:53:41 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:42 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a" returned: 0 in 0.266s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.690s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e719a0-420e-4f40-be7f-040e1bcd92b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d834aec5-8f3a-4be3-a932-709cc1491968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Creating offline snapshot 51eb60dc-a678-493a-840d-fb7edfcf5166 of volume a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:53:42 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Volume volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a (d8ec485b-9ce4-4699-8320-4ea79aed9d1a): created successfully Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d834aec5-8f3a-4be3-a932-709cc1491968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Flow 'volume_create_manager' (737d27a1-904f-479e-ab87-9c2bafac8a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[61606d93-1813-4dce-826c-1437fc7b5e06]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:42 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d436c868-49cb-43d1-9fb0-ea4be5615790" returned: 0 in 0.285s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-d436c868-49cb-43d1-9fb0-ea4be5615790" released by "delete_volume" :: held 0.732s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5bc315fc-e0cd-4a7b-9415-5ff1636acd80 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Created volume successfully. Sep 08 13:53:42 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 Sep 08 13:53:42 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Created reservations ['e1b373f8-0a10-4a03-b635-30c7686ff97e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:42 devstack cinder-volume[87262]: WARNING cinder.quota [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-102557488 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-102557488, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:53:42 devstack cinder-volume[87262]: WARNING cinder.quota [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-102557488 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-102557488, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Created reservations ['32b87d30-6275-4d3f-9b68-1320b0e707e5', 'd107742c-ed75-4032-9be7-defe045b045a', '8185dc4b-af0e-4c6c-870d-c73d68bd2017', '3a7f90ab-e0ba-491f-96f0-7049715554db'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:42 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:42 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:42 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478" returned: 0 in 0.419s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:42 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 1G Sep 08 13:53:42 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:42 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Flow 'volume_create_manager' (c667fa8b-4ff4-4865-ba47-b29da8851818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cde7314-8279-4bc5-8788-c7b53b22ecf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 1f54f438-d864-4239-b23f-537427eb466c: deleting Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.360s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a0bf8631-6f77-4793-8de7-49f0bd79c5bd tempest-GroupSnapshotsTest-990695160 None] Delete group completed successfully. Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cde7314-8279-4bc5-8788-c7b53b22ecf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1154872609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39619c8a-23d9-4714-b1ce-86cffab5f14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370e45a44e4ab2ba5f1fd7174c88c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:43Z,use_quota=True,user_id='52db2484b89a4ff8b9f8df7445265575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2b2957-75f6-4128-9afd-b52d92c9f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2b2957-75f6-4128-9afd-b52d92c9f15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cdb683-92cf-431c-9a4a-d6b12cb6f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cdb683-92cf-431c-9a4a-d6b12cb6f256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39619c8a-23d9-4714-b1ce-86cffab5f14e', 'volume_name': 'volume-39619c8a-23d9-4714-b1ce-86cffab5f14e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce735db-e45c-4b23-9e54-8d965360891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce735db-e45c-4b23-9e54-8d965360891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc9bc86-134a-4d0c-acd3-ca399af0f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:42 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Volume 39619c8a-23d9-4714-b1ce-86cffab5f14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39619c8a-23d9-4714-b1ce-86cffab5f14e', 'volume_size': 1} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 1f54f438-d864-4239-b23f-537427eb466c: deleting {{(pid=87262) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-b6533bec-a208-4b16-b1ac-272b081eacee" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-b6533bec-a208-4b16-b1ac-272b081eacee" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Deleting offline snapshot b6533bec-a208-4b16-b1ac-272b081eacee of volume f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] snapshot_file for this snap is: volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbb4565-e553-4063-aada-d2d194568858]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:43 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee Sep 08 13:53:43 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:43 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 1G" returned: 0 in 0.613s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e33698-268d-42cc-9f54-59016e70a478 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:43 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e33698-268d-42cc-9f54-59016e70a478 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 Sep 08 13:53:43 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:43 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee" returned: 0 in 0.424s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de2fe88-4903-4e3f-bead-aeb63329ad68]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:43 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e33698-268d-42cc-9f54-59016e70a478 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166" returned: 0 in 0.333s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:43 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 is being set with open permissions: ugo+rw Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:43 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 Sep 08 13:53:43 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:43 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 Sep 08 13:53:43 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:43 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166" returned: 0 in 0.254s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:43 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.info Sep 08 13:53:43 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Acquiring lock "cinder-d8ec485b-9ce4-4699-8320-4ea79aed9d1a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "cinder-d8ec485b-9ce4-4699-8320-4ea79aed9d1a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Acquiring lock "cinder-quobyte-d8ec485b-9ce4-4699-8320-4ea79aed9d1a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "cinder-quobyte-d8ec485b-9ce4-4699-8320-4ea79aed9d1a" acquired by "delete_volume" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0c21d9-78ef-40fb-9251-87ace5adc1b9]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:43 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" returned: 0 in 0.555s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:44 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee Sep 08 13:53:44 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:44 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.info" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:44 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.info is being set with open permissions: ugo+rw Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:44 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a Sep 08 13:53:44 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:44 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.info Sep 08 13:53:44 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:44 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.info" returned: 0 in 0.264s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:44 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1154872609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39619c8a-23d9-4714-b1ce-86cffab5f14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370e45a44e4ab2ba5f1fd7174c88c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:43Z,use_quota=True,user_id='52db2484b89a4ff8b9f8df7445265575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Creating volume 39619c8a-23d9-4714-b1ce-86cffab5f14e {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:44 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:44 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee" returned: 0 in 0.400s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:44 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e 1073741824 Sep 08 13:53:44 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a" returned: 0 in 0.444s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:44 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee Sep 08 13:53:44 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-094bc84d-372d-49ee-8f50-7bd49b75ef3d tempest-VolumesExtendTest-1763169399 None] Create snapshot completed successfully Sep 08 13:53:44 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a Sep 08 13:53:44 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:44 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80.b6533bec-a208-4b16-b1ac-272b081eacee" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:44 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d8ec485b-9ce4-4699-8320-4ea79aed9d1a" returned: 0 in 0.269s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-b6533bec-a208-4b16-b1ac-272b081eacee" released by "_delete_snapshot" :: held 1.746s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "cinder-quobyte-d8ec485b-9ce4-4699-8320-4ea79aed9d1a" released by "delete_volume" :: held 0.758s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" released by "delete_snapshot" :: held 1.777s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Created reservations ['3707aab7-9fab-43aa-9455-4a96b4f5d9c4', 'a2d9f0e8-0101-45e6-beb4-c00501b4061e', '72fe0096-6361-486e-9dec-727282feb9d2', 'cbba5265-ff6e-4998-8277-93f2b559a6c6'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:44 devstack cinder-volume[87262]: WARNING cinder.quota [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-102557488 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-102557488, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] Created reservations ['003bf47f-bf63-4140-899b-0d467e2ccb8a', '192b08cc-7600-41f5-bf82-51f108a51de0', 'dbb14cfe-ac3b-49a5-9fc3-63df7eee221c', 'fb763074-0f57-42b4-b1b0-875e30efbfbc'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:44 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e 1073741824" returned: 0 in 0.527s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:44 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:44 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f845f891-3363-47d9-a10c-217af1599e55 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 1f54f438-d864-4239-b23f-537427eb466c: deleted successfully Sep 08 13:53:44 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e Sep 08 13:53:44 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:45 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.307s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Deleted volume successfully. Sep 08 13:53:45 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6f975371-96b6-45df-859b-c1cd25f4aa55 tempest-VolumeQuotasNegativeTestJSON-996706149 None] Lock "cinder-d8ec485b-9ce4-4699-8320-4ea79aed9d1a-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e" returned: 0 in 0.299s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc9bc86-134a-4d0c-acd3-ca399af0f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39619c8a-23d9-4714-b1ce-86cffab5f14e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ced5d7-a916-4c05-b2df-b745386bb2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:45 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Volume volume-39619c8a-23d9-4714-b1ce-86cffab5f14e (39619c8a-23d9-4714-b1ce-86cffab5f14e): created successfully Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ced5d7-a916-4c05-b2df-b745386bb2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Flow 'volume_create_manager' (c667fa8b-4ff4-4865-ba47-b29da8851818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5cbae388-9f19-4aa2-b22e-5c121c594c0c tempest-VolumesListAdminTestJSON-2122415767 None] Created volume successfully. Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5903e57e-9588-4f2e-a384-e0b41f95b299]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-578b6bd1-0a4a-49f5-b239-1999ec174171 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-578b6bd1-0a4a-49f5-b239-1999ec174171 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[39971566-0373-4a43-b0b2-f22b2a4641e8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-578b6bd1-0a4a-49f5-b239-1999ec174171 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:45 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 Sep 08 13:53:45 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:45 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 Sep 08 13:53:45 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:46 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-578b6bd1-0a4a-49f5-b239-1999ec174171 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478" returned: 0 in 0.563s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:46 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-578b6bd1-0a4a-49f5-b239-1999ec174171 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 2G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" returned: 0 in 0.700s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:46 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80 Sep 08 13:53:46 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-578b6bd1-0a4a-49f5-b239-1999ec174171 tempest-VolumesExtendTest-1763169399 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 2G" returned: 0 in 0.177s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-578b6bd1-0a4a-49f5-b239-1999ec174171 tempest-VolumesExtendTest-1763169399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.800s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:46 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-578b6bd1-0a4a-49f5-b239-1999ec174171 tempest-VolumesExtendTest-1763169399 None] Extend volume completed successfully. Sep 08 13:53:46 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" returned: 0 in 0.329s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-f6f9d2f9-4b48-4ce8-9f11-1b9b2a68fc80" released by "delete_volume" :: held 1.119s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Flow 'volume_create_manager' (5c65c826-618b-4cfd-ab7b-a5c641b4cef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039e58d3-cf2e-4ab7-9034-500dde83003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039e58d3-cf2e-4ab7-9034-500dde83003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1989184203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a3877c-8fb8-448a-ad81-baef5eb2ff11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370e45a44e4ab2ba5f1fd7174c88c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:47Z,use_quota=True,user_id='52db2484b89a4ff8b9f8df7445265575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641fc81f-c9e4-4c1d-82bd-7873f44f57ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641fc81f-c9e4-4c1d-82bd-7873f44f57ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea64c9e-ddb5-4832-96fa-d8f05bbb03c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea64c9e-ddb5-4832-96fa-d8f05bbb03c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a3877c-8fb8-448a-ad81-baef5eb2ff11', 'volume_name': 'volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8fed3c-537c-4ffd-a29f-abaea0c86375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8fed3c-537c-4ffd-a29f-abaea0c86375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4321a4d-8f1c-42ef-8478-d37c292ec536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:46 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Volume 95a3877c-8fb8-448a-ad81-baef5eb2ff11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11', 'volume_size': 1} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1989184203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a3877c-8fb8-448a-ad81-baef5eb2ff11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370e45a44e4ab2ba5f1fd7174c88c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:47Z,use_quota=True,user_id='52db2484b89a4ff8b9f8df7445265575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Creating volume 95a3877c-8fb8-448a-ad81-baef5eb2ff11 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:46 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:46 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 1073741824 Sep 08 13:53:46 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:46 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Created reservations ['7cfd0674-6ef0-47d3-a7ac-815d7ec29b74'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:47 devstack cinder-volume[87262]: WARNING cinder.db.api [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-102557488'] Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Created reservations ['80c1b06a-af59-4fb7-9553-930827b49efa', '0f41da3f-d301-453c-9efe-ad30b222fc29', '8e18815b-2135-4ca4-9a0f-ae65aabac972', 'd3f6cdd1-04e0-45e9-9b3c-93c90261d307'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "cinder-51eb60dc-a678-493a-840d-fb7edfcf5166-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-51eb60dc-a678-493a-840d-fb7edfcf5166-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "cinder-quobyte-a8e33698-268d-42cc-9f54-59016e70a478" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-quobyte-a8e33698-268d-42cc-9f54-59016e70a478" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Acquiring lock "cinder-quobyte-51eb60dc-a678-493a-840d-fb7edfcf5166" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-quobyte-51eb60dc-a678-493a-840d-fb7edfcf5166" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Deleting offline snapshot 51eb60dc-a678-493a-840d-fb7edfcf5166 of volume a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:53:47 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:47 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] snapshot_file for this snap is: volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2751bc-23a2-456a-acb4-f77584549615]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:47 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 1073741824" returned: 0 in 0.545s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:47 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 Sep 08 13:53:47 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:47 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 Sep 08 13:53:47 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:47 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.296s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:47 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6164d576-3490-4cae-8d24-c4c9a90a6e33 tempest-GroupSnapshotsTest-990695160 None] Delete group completed successfully. Sep 08 13:53:47 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11" returned: 0 in 0.307s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:47 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4321a4d-8f1c-42ef-8478-d37c292ec536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948b8107-3b1d-4cab-ab3d-ec9b5f83009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166" returned: 0 in 0.469s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e33698-268d-42cc-9f54-59016e70a478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:53:47 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Volume volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 (95a3877c-8fb8-448a-ad81-baef5eb2ff11): created successfully Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948b8107-3b1d-4cab-ab3d-ec9b5f83009d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Flow 'volume_create_manager' (5c65c826-618b-4cfd-ab7b-a5c641b4cef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b5cc89-943e-4bbe-8a50-824a62ded2e8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:47 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-050ffd06-596f-4ec9-8f01-cd889cb4ced5 tempest-VolumesListAdminTestJSON-2122415767 None] Created volume successfully. Sep 08 13:53:47 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 Sep 08 13:53:47 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:48 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478" returned: 0 in 0.414s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:48 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 Sep 08 13:53:48 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7be5090b-b640-4007-b1f7-0b50601876c9 tempest-GroupSnapshotsTest-990695160 None] Group tempest-GroupSnapshotsTest-Group-1651527217: creating Sep 08 13:53:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7be5090b-b640-4007-b1f7-0b50601876c9 tempest-GroupSnapshotsTest-990695160 None] Group tempest-GroupSnapshotsTest-Group-1651527217: created successfully Sep 08 13:53:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7be5090b-b640-4007-b1f7-0b50601876c9 tempest-GroupSnapshotsTest-990695160 None] Create group completed successfully. Sep 08 13:53:48 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166" returned: 0 in 0.481s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:48 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166 Sep 08 13:53:48 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:49 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478.51eb60dc-a678-493a-840d-fb7edfcf5166" returned: 0 in 0.285s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-quobyte-51eb60dc-a678-493a-840d-fb7edfcf5166" released by "_delete_snapshot" :: held 1.810s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-quobyte-a8e33698-268d-42cc-9f54-59016e70a478" released by "delete_snapshot" :: held 1.874s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Created reservations ['ffc1af36-e622-4b1c-8b71-6a7142c2583a', 'e199e535-e079-4d80-b9f9-259ac03e001f', 'e9049999-0b29-4333-a02c-40a95b42b415', '25b82fa3-7e26-4f50-8cf7-87281b59109c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:49 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Delete snapshot completed successfully. Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a218984a-b200-4f6a-b75c-b5f6b83b28e5 tempest-VolumesExtendTest-1763169399 None] Lock "cinder-51eb60dc-a678-493a-840d-fb7edfcf5166-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Acquiring lock "cinder-a8e33698-268d-42cc-9f54-59016e70a478-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Lock "cinder-a8e33698-268d-42cc-9f54-59016e70a478-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Acquiring lock "cinder-quobyte-a8e33698-268d-42cc-9f54-59016e70a478" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Lock "cinder-quobyte-a8e33698-268d-42cc-9f54-59016e70a478" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9dd157-3a80-43da-bf79-ab3ce746def5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:49 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 Sep 08 13:53:49 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Flow 'volume_create_manager' (c6e00d5f-c43a-454d-bdde-61ef5c3f4b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbecfda9-59b6-43fc-ae28-cd95f62a3e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbecfda9-59b6-43fc-ae28-cd95f62a3e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e49702-53e2-4dfd-a253-a98cfbc5fdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d332441e46422fac68572b18a20d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:50Z,use_quota=True,user_id='d9e32a80554648ea8c42036a28d0b19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7474a340-00b3-4f88-9179-a372f8d3bded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7474a340-00b3-4f88-9179-a372f8d3bded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d76eda-fc2f-44fb-ae0c-c20f62b5631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d76eda-fc2f-44fb-ae0c-c20f62b5631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e49702-53e2-4dfd-a253-a98cfbc5fdb1', 'volume_name': 'volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a37867-d03a-43c5-81a6-a588ff3ca36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a37867-d03a-43c5-81a6-a588ff3ca36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5b0155-6890-427b-83a9-c55b45af4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:49 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Volume 72e49702-53e2-4dfd-a253-a98cfbc5fdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1', 'volume_size': 1} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e49702-53e2-4dfd-a253-a98cfbc5fdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d332441e46422fac68572b18a20d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:50Z,use_quota=True,user_id='d9e32a80554648ea8c42036a28d0b19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Creating volume 72e49702-53e2-4dfd-a253-a98cfbc5fdb1 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:50 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:50 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478" returned: 0 in 0.511s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:50 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 1073741824 Sep 08 13:53:50 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:50 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478 Sep 08 13:53:50 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:50 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a8e33698-268d-42cc-9f54-59016e70a478" returned: 0 in 0.310s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Lock "cinder-quobyte-a8e33698-268d-42cc-9f54-59016e70a478" released by "delete_volume" :: held 0.904s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Flow 'volume_create_manager' (f1b8e07a-01cf-442d-9518-1b45b4bc1624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8be252-ebdf-41f3-979a-2e344d7155a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8be252-ebdf-41f3-979a-2e344d7155a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1610509934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=005a5cdf-9b76-4e67-b0d8-0c40e2cb1548,host='devstack@QuobyteHD#QuobyteHD',id=c8f5cc37-89a6-4063-9eb0-56d3162506db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec843dbc4f478cb0c07a98bf49ab5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:50Z,use_quota=True,user_id='4780d14742ea444286bec3ee3d06ac17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c30592aa-e324-4a95-b30b-5465d8147acb),volume_type_id=c30592aa-e324-4a95-b30b-5465d8147acb)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c6ad62-1dea-4f70-9508-cd310fc0d0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c6ad62-1dea-4f70-9508-cd310fc0d0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62079a65-a930-441d-bed5-d8a162bfe240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62079a65-a930-441d-bed5-d8a162bfe240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f5cc37-89a6-4063-9eb0-56d3162506db', 'volume_name': 'volume-c8f5cc37-89a6-4063-9eb0-56d3162506db', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddff7e7-7a2c-4847-9608-861fa103e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddff7e7-7a2c-4847-9608-861fa103e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf102637-ed7e-4c0f-8b7d-a5236651c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Volume c8f5cc37-89a6-4063-9eb0-56d3162506db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f5cc37-89a6-4063-9eb0-56d3162506db', 'volume_size': 1} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Created reservations ['c288f845-0533-4c7b-8c04-cfe07ab3b11e', 'f83337c6-ff92-4345-b86e-2c7f426d7c7c', '9439d353-45f5-4337-97bc-9f05c8c8bb6e', 'cb4add9c-6ccb-4c72-9ab0-a921f9ae8cca'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:50 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 1073741824" returned: 0 in 0.665s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:50 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:50 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:50 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 Sep 08 13:53:50 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:50 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.286s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:50 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Deleted volume successfully. Sep 08 13:53:50 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1" returned: 0 in 0.262s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=005a5cdf-9b76-4e67-b0d8-0c40e2cb1548,created_at=2026-09-08T11:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1610509934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=005a5cdf-9b76-4e67-b0d8-0c40e2cb1548,host='devstack@QuobyteHD#QuobyteHD',id=c8f5cc37-89a6-4063-9eb0-56d3162506db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec843dbc4f478cb0c07a98bf49ab5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:50Z,use_quota=True,user_id='4780d14742ea444286bec3ee3d06ac17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c30592aa-e324-4a95-b30b-5465d8147acb),volume_type_id=c30592aa-e324-4a95-b30b-5465d8147acb)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Creating volume c8f5cc37-89a6-4063-9eb0-56d3162506db {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:50 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-734ff773-b1ac-4ad9-bee7-1f4e5512175e tempest-VolumesExtendTest-1763169399 None] Lock "cinder-a8e33698-268d-42cc-9f54-59016e70a478-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5b0155-6890-427b-83a9-c55b45af4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:51 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db 1073741824 Sep 08 13:53:51 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b98b3eb-cd30-43d2-9d6e-1b827e2338da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:51 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Volume volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 (72e49702-53e2-4dfd-a253-a98cfbc5fdb1): created successfully Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b98b3eb-cd30-43d2-9d6e-1b827e2338da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Flow 'volume_create_manager' (c6e00d5f-c43a-454d-bdde-61ef5c3f4b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d319507c-0b25-4c88-884e-36019caf7fc9 tempest-VolumesListAdminTestJSON-795754579 None] Created volume successfully. Sep 08 13:53:51 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db 1073741824" returned: 0 in 0.452s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:51 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db Sep 08 13:53:51 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:51 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db" returned: 0 in 0.264s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf102637-ed7e-4c0f-8b7d-a5236651c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f5cc37-89a6-4063-9eb0-56d3162506db', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a2c2cc-f840-4283-99d7-e67c0100a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:51 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Volume volume-c8f5cc37-89a6-4063-9eb0-56d3162506db (c8f5cc37-89a6-4063-9eb0-56d3162506db): created successfully Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a2c2cc-f840-4283-99d7-e67c0100a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Flow 'volume_create_manager' (f1b8e07a-01cf-442d-9518-1b45b4bc1624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8b941f6b-1202-45b3-b738-3e96271ba6d9 tempest-GroupSnapshotsTest-990695160 None] Created volume successfully. Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Acquiring lock "cinder-72e49702-53e2-4dfd-a253-a98cfbc5fdb1-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Lock "cinder-72e49702-53e2-4dfd-a253-a98cfbc5fdb1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Acquiring lock "cinder-quobyte-72e49702-53e2-4dfd-a253-a98cfbc5fdb1" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Lock "cinder-quobyte-72e49702-53e2-4dfd-a253-a98cfbc5fdb1" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c17c9b-b932-4292-9309-c3098d879b31]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "cinder-95a3877c-8fb8-448a-ad81-baef5eb2ff11-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-95a3877c-8fb8-448a-ad81-baef5eb2ff11-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "cinder-quobyte-95a3877c-8fb8-448a-ad81-baef5eb2ff11" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-quobyte-95a3877c-8fb8-448a-ad81-baef5eb2ff11" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[481ef4d3-cef3-463b-8d04-8c63037e5c01]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:52 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 Sep 08 13:53:52 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:52 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 Sep 08 13:53:52 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:52 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Flow 'volume_create_manager' (cc9780d7-cd0d-423d-b4f6-acc20d7d0355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d22cac0-97a0-464e-8da2-12bb271b8444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1" returned: 0 in 0.531s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:52 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1 Sep 08 13:53:52 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d22cac0-97a0-464e-8da2-12bb271b8444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-264551163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8958e85d-210e-413a-b1f2-edae1f284922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7e72e96f2647b59946de7f1c4c893f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:53Z,use_quota=True,user_id='d6da2993345f4c84a00f0927651eed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71b84490-9730-4699-86bf-6711c938230c),volume_type_id=71b84490-9730-4699-86bf-6711c938230c)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e80cee-9f38-43ee-b5a2-404c69d7447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e80cee-9f38-43ee-b5a2-404c69d7447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bd08c8-ce65-4242-864b-cb641ae82745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bd08c8-ce65-4242-864b-cb641ae82745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8958e85d-210e-413a-b1f2-edae1f284922', 'volume_name': 'volume-8958e85d-210e-413a-b1f2-edae1f284922', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e4aa27-46dd-4ccd-9bd2-73ff2b0ad295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:52 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e4aa27-46dd-4ccd-9bd2-73ff2b0ad295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a0e423-37ba-4429-acc2-042e8f1d73d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:52 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Volume 8958e85d-210e-413a-b1f2-edae1f284922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8958e85d-210e-413a-b1f2-edae1f284922', 'volume_size': 1} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-264551163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8958e85d-210e-413a-b1f2-edae1f284922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7e72e96f2647b59946de7f1c4c893f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:53Z,use_quota=True,user_id='d6da2993345f4c84a00f0927651eed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71b84490-9730-4699-86bf-6711c938230c),volume_type_id=71b84490-9730-4699-86bf-6711c938230c)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Creating volume 8958e85d-210e-413a-b1f2-edae1f284922 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:52 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11" returned: 0 in 0.533s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:52 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 1073741824 Sep 08 13:53:52 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:52 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11 Sep 08 13:53:52 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:53 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72e49702-53e2-4dfd-a253-a98cfbc5fdb1" returned: 0 in 0.302s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Lock "cinder-quobyte-72e49702-53e2-4dfd-a253-a98cfbc5fdb1" released by "delete_volume" :: held 0.916s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Created reservations ['3bfd4cf4-ac9d-4be9-a9de-f4db04658ca0', '4621c4d1-8f78-46cb-a810-fc86ec723370', 'c02d13f1-57c3-4f82-ac14-1a3831c49b77', 'f853180b-0150-4910-934e-8baf09c4bf8d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:53 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95a3877c-8fb8-448a-ad81-baef5eb2ff11" returned: 0 in 0.384s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-quobyte-95a3877c-8fb8-448a-ad81-baef5eb2ff11" released by "delete_volume" :: held 1.006s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:53 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:53 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Created reservations ['a5d33088-d0d6-459d-bc05-998d0753ed69', 'ae75fa48-3342-4664-821f-b40ddfff9316', 'f8578a03-c685-4099-9fa8-39d63fa1b6e8', 'de4f8804-6730-4c2e-8c42-4e9e71618299'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:53 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:53 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:53 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 1073741824" returned: 0 in 0.874s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:53 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.460s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Flow 'volume_create_manager' (9c9d5d00-3770-4dbf-b044-65778d6740ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df56dad-2260-4311-bfd2-b4158d112a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:53 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Deleted volume successfully. Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:53 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 Sep 08 13:53:53 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df56dad-2260-4311-bfd2-b4158d112a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-276358865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=005a5cdf-9b76-4e67-b0d8-0c40e2cb1548,host='devstack@QuobyteHD#QuobyteHD',id=d1befcc3-7113-48ba-93f0-af199c409af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec843dbc4f478cb0c07a98bf49ab5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:54Z,use_quota=True,user_id='4780d14742ea444286bec3ee3d06ac17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c30592aa-e324-4a95-b30b-5465d8147acb),volume_type_id=c30592aa-e324-4a95-b30b-5465d8147acb)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0b4b5e-9e8b-47e0-8f60-829b32da418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0b4b5e-9e8b-47e0-8f60-829b32da418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034da6a7-1e67-4989-836f-613c800c94ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034da6a7-1e67-4989-836f-613c800c94ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1befcc3-7113-48ba-93f0-af199c409af5', 'volume_name': 'volume-d1befcc3-7113-48ba-93f0-af199c409af5', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b28c064-bd3a-420b-9d51-a6f0ba97e565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b28c064-bd3a-420b-9d51-a6f0ba97e565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d23c8a3-0af1-4e90-bd02-bded480b7f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:53 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Volume d1befcc3-7113-48ba-93f0-af199c409af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1befcc3-7113-48ba-93f0-af199c409af5', 'volume_size': 1} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aaac67d8-1240-4ed4-a094-a1fdf36a2293 tempest-VolumesListAdminTestJSON-795754579 None] Lock "cinder-72e49702-53e2-4dfd-a253-a98cfbc5fdb1-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:54 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.386s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Deleted volume successfully. Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-73048c87-4f92-4fb9-97ad-2f208accf11a tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-95a3877c-8fb8-448a-ad81-baef5eb2ff11-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:54 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922" returned: 0 in 0.305s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.220s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=005a5cdf-9b76-4e67-b0d8-0c40e2cb1548,created_at=2026-09-08T11:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-276358865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=005a5cdf-9b76-4e67-b0d8-0c40e2cb1548,host='devstack@QuobyteHD#QuobyteHD',id=d1befcc3-7113-48ba-93f0-af199c409af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec843dbc4f478cb0c07a98bf49ab5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:54Z,use_quota=True,user_id='4780d14742ea444286bec3ee3d06ac17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c30592aa-e324-4a95-b30b-5465d8147acb),volume_type_id=c30592aa-e324-4a95-b30b-5465d8147acb)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Creating volume d1befcc3-7113-48ba-93f0-af199c409af5 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:54 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a0e423-37ba-4429-acc2-042e8f1d73d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8958e85d-210e-413a-b1f2-edae1f284922', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:54 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 1073741824 Sep 08 13:53:54 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02feeb8e-5df7-416c-a544-42b291786b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:54 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Volume volume-8958e85d-210e-413a-b1f2-edae1f284922 (8958e85d-210e-413a-b1f2-edae1f284922): created successfully Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02feeb8e-5df7-416c-a544-42b291786b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Flow 'volume_create_manager' (cc9780d7-cd0d-423d-b4f6-acc20d7d0355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-385d2e2c-219d-45d4-b2eb-3ab0c1aad49f tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Created volume successfully. Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "cinder-39619c8a-23d9-4714-b1ce-86cffab5f14e-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-39619c8a-23d9-4714-b1ce-86cffab5f14e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "cinder-quobyte-39619c8a-23d9-4714-b1ce-86cffab5f14e" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-quobyte-39619c8a-23d9-4714-b1ce-86cffab5f14e" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:54 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 1073741824" returned: 0 in 0.537s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dc7a76-684e-4c95-924b-e04904fe650c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:54 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 Sep 08 13:53:54 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:54 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e Sep 08 13:53:54 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:55 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5" returned: 0 in 0.402s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d23c8a3-0af1-4e90-bd02-bded480b7f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1befcc3-7113-48ba-93f0-af199c409af5', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7156d43e-97e6-4c98-a4e9-21015db1f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:55 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Volume volume-d1befcc3-7113-48ba-93f0-af199c409af5 (d1befcc3-7113-48ba-93f0-af199c409af5): created successfully Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7156d43e-97e6-4c98-a4e9-21015db1f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:55 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Flow 'volume_create_manager' (9c9d5d00-3770-4dbf-b044-65778d6740ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e" returned: 0 in 0.510s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ad67b0fb-a508-4b26-88fc-e1c3dba5f70a tempest-GroupSnapshotsTest-990695160 None] Created volume successfully. Sep 08 13:53:55 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e Sep 08 13:53:55 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:55 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:55 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:55 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-39619c8a-23d9-4714-b1ce-86cffab5f14e" returned: 0 in 0.292s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-quobyte-39619c8a-23d9-4714-b1ce-86cffab5f14e" released by "delete_volume" :: held 0.857s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Created reservations ['63d835f0-d946-4d81-a742-023d321b3f08', '1c3125ad-c20f-47e9-ae42-6dc971fd2478', '22986f8b-12bd-4dfa-bbf6-0feaef152f31', '0b3d1444-73c3-4cc0-b1b4-daa446701309'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:55 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4a0dd7cb-a889-4d07-a819-b668e6544a06 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Retype volume completed successfully. Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:55 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:55 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "cinder-5219739f-4eb0-4a6f-b0ee-5fea093218f7-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-5219739f-4eb0-4a6f-b0ee-5fea093218f7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "cinder-quobyte-5219739f-4eb0-4a6f-b0ee-5fea093218f7" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:55 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.283s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:55 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-quobyte-5219739f-4eb0-4a6f-b0ee-5fea093218f7" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:56 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Deleted volume successfully. Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c846bf-e181-4698-a335-be40029a3721]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aca66c2b-f8e0-455b-935f-3f7e1e46b471 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-39619c8a-23d9-4714-b1ce-86cffab5f14e-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:56 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 Sep 08 13:53:56 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:56 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Flow 'volume_create_manager' (ad73b0e3-1276-4a54-9816-20aaea86b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16600d8-ae2e-4a40-81ea-c1e76bfe256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7" returned: 0 in 0.536s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:56 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1ea1d21b-bc9f-45fd-bcbc-7ba99196e88b tempest-GroupSnapshotsTest-990695160 None] Update group completed successfully. Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16600d8-ae2e-4a40-81ea-c1e76bfe256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-20218729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f764389-6230-43a6-8091-39108eeb7887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d656518d3840689f3dc98dda3d108b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:56Z,use_quota=True,user_id='43459a8dfaad4ca995a5d26f238d400f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:56 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7 Sep 08 13:53:56 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34770deb-c25c-4050-885d-46acce4258fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34770deb-c25c-4050-885d-46acce4258fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845f93d7-bc18-4c43-876f-cf13a89c1313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845f93d7-bc18-4c43-876f-cf13a89c1313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f764389-6230-43a6-8091-39108eeb7887', 'volume_name': 'volume-2f764389-6230-43a6-8091-39108eeb7887', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d32505-9ac3-481b-a693-8eed1b6cf62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d32505-9ac3-481b-a693-8eed1b6cf62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab38b28d-158b-4c20-88df-5008d08b8b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:56 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Volume 2f764389-6230-43a6-8091-39108eeb7887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f764389-6230-43a6-8091-39108eeb7887', 'volume_size': 1} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-20218729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f764389-6230-43a6-8091-39108eeb7887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d656518d3840689f3dc98dda3d108b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:53:56Z,use_quota=True,user_id='43459a8dfaad4ca995a5d26f238d400f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Creating volume 2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:53:56 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Acquiring lock "cinder-8958e85d-210e-413a-b1f2-edae1f284922-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:56 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 1073741824 Sep 08 13:53:56 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "cinder-8958e85d-210e-413a-b1f2-edae1f284922-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Acquiring lock "cinder-quobyte-8958e85d-210e-413a-b1f2-edae1f284922" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "cinder-quobyte-8958e85d-210e-413a-b1f2-edae1f284922" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6107b5-7beb-4737-b13d-7274700a6aad]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:56 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5219739f-4eb0-4a6f-b0ee-5fea093218f7" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:56 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 Sep 08 13:53:56 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-quobyte-5219739f-4eb0-4a6f-b0ee-5fea093218f7" released by "delete_volume" :: held 0.883s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:56 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Created reservations ['b73d9f47-256a-4139-812f-8adab3ff287e', '7713c943-70ee-482c-8c69-3904e837f162', 'd9f40678-64bd-4530-b34a-612b117ec9d8', 'c68e33af-8636-4e49-a72d-4dfef22dfbc6'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:57 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:57 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:57 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922" returned: 0 in 0.435s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:57 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922 Sep 08 13:53:57 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:57 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 1073741824" returned: 0 in 0.604s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:57 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 Sep 08 13:53:57 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:57 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Deleted volume successfully. Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40605ca4-82ae-4f8e-822b-7f4f7b49ffb7 tempest-VolumesListAdminTestJSON-2122415767 None] Lock "cinder-5219739f-4eb0-4a6f-b0ee-5fea093218f7-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:57 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8958e85d-210e-413a-b1f2-edae1f284922" returned: 0 in 0.308s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "cinder-quobyte-8958e85d-210e-413a-b1f2-edae1f284922" released by "delete_volume" :: held 0.788s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:57 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:57 devstack cinder-volume[87262]: WARNING cinder.quota [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:53:57 devstack cinder-volume[87262]: WARNING cinder.quota [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887" returned: 0 in 0.273s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab38b28d-158b-4c20-88df-5008d08b8b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f764389-6230-43a6-8091-39108eeb7887', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0615102d-3d76-4114-8d18-65ee1bee93f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Created reservations ['55d7cb85-83a0-43f6-94e4-a5d49640c69a', 'a63e4ac6-1a47-4303-92a1-40d323faa7fb', '33b8ad4b-0da2-423a-8c11-9889a7a7d295', '820a3395-eaaa-4c7a-aadb-6fbd4bcc687c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:53:57 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Volume volume-2f764389-6230-43a6-8091-39108eeb7887 (2f764389-6230-43a6-8091-39108eeb7887): created successfully Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0615102d-3d76-4114-8d18-65ee1bee93f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Flow 'volume_create_manager' (ad73b0e3-1276-4a54-9816-20aaea86b585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:53:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-525f8732-6c2c-42e7-9bcd-47ddaff8bc4d tempest-VolumesSnapshotListTestJSON-849260681 None] Created volume successfully. Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:57 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:53:57 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cc7e8319-58d7-4e3c-8408-b7d2964e9b85 tempest-GroupSnapshotsTest-990695160 None] Update group completed successfully. Sep 08 13:53:57 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.249s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:53:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Deleted volume successfully. Sep 08 13:53:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-09adb515-1eed-4a58-901f-1e23f9533d03 tempest-VolumeRetypeWithoutMigrationTest-621878209 None] Lock "cinder-8958e85d-210e-413a-b1f2-edae1f284922-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:53:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:53:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:53:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Creating offline snapshot ad71767f-c521-4e7f-88eb-c94c66308d74 of volume 2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:53:58 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d88b2b-e9c1-4f2a-9d8a-39a53eccdc84]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:53:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:59 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5e7f1043-e5b8-4599-a98c-a55d74b32256 tempest-GroupSnapshotsTest-990695160 None] Update group completed successfully. Sep 08 13:53:59 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 Sep 08 13:53:59 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:59 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887" returned: 0 in 0.504s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:59 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 1G Sep 08 13:53:59 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:53:59 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Sep 08 13:53:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 1G" returned: 0 in 0.504s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:53:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:53:59 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 Sep 08 13:53:59 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:00 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74" returned: 0 in 0.326s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:00 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 is being set with open permissions: ugo+rw Sep 08 13:54:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:00 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 Sep 08 13:54:00 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a07427fd-94b0-4d74-9aaa-134dd3e00aa7 tempest-GroupSnapshotsTest-990695160 None] Update group completed successfully. Sep 08 13:54:00 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74" returned: 0 in 0.340s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:00 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.info Sep 08 13:54:00 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:00 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.info" returned: 0 in 0.340s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:00 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.info is being set with open permissions: ugo+rw Sep 08 13:54:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:00 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.info Sep 08 13:54:00 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:01 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.info" returned: 0 in 0.300s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fe2eedfd-9b4a-41c2-958a-80c8461711a1 tempest-VolumesSnapshotListTestJSON-849260681 None] Create snapshot completed successfully Sep 08 13:54:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] GroupSnapshot 177fe327-dbc7-4609-9805-378188a2ab76: creating. Sep 08 13:54:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Group snapshot 177fe327-dbc7-4609-9805-378188a2ab76: creating. {{(pid=87262) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 13:54:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Creating offline snapshot 2131cf3d-7429-424e-be49-5d9c9bcff1ef of volume d1befcc3-7113-48ba-93f0-af199c409af5 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:54:01 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[524179c2-9358-4b84-86c1-27e8fc316c9d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:02 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 Sep 08 13:54:02 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:02 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5" returned: 0 in 0.594s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:02 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef 1G Sep 08 13:54:02 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:02 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef 1G" returned: 0 in 0.487s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1befcc3-7113-48ba-93f0-af199c409af5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:03 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1befcc3-7113-48ba-93f0-af199c409af5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef Sep 08 13:54:03 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:03 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:03 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:03 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1befcc3-7113-48ba-93f0-af199c409af5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef" returned: 0 in 0.346s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:03 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:03 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef Sep 08 13:54:03 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:03 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.328s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:54:03 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef" returned: 0 in 0.281s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:03 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.info Sep 08 13:54:03 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:03 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.info" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:03 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:54:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:03 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.info Sep 08 13:54:03 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:04 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.info" returned: 0 in 0.301s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Creating offline snapshot c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 of volume c8f5cc37-89a6-4063-9eb0-56d3162506db {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0711707a-0176-4697-b6cc-70997fdb599e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:04 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db Sep 08 13:54:04 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:04 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db" returned: 0 in 0.428s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:04 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 1G Sep 08 13:54:04 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:05 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 1G" returned: 0 in 0.508s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f5cc37-89a6-4063-9eb0-56d3162506db -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:05 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f5cc37-89a6-4063-9eb0-56d3162506db -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 Sep 08 13:54:05 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:05 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f5cc37-89a6-4063-9eb0-56d3162506db -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00" returned: 0 in 0.331s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:05 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:54:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:05 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 Sep 08 13:54:05 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:05 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00" returned: 0 in 0.269s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:05 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=188,cinder:INSERT=49,cinder:UPDATE=194,cinder:DELETE=11 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:54:05 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=163,cinder:INSERT=54,cinder:UPDATE=217,cinder:DELETE=18 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:54:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:05 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.info Sep 08 13:54:05 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:06 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.info" returned: 0 in 0.303s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:06 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:54:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:06 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.info Sep 08 13:54:06 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:06 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.info" returned: 0 in 0.327s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.246s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Creating offline snapshot faa5718b-a293-4325-b832-11cd8426a44e of volume 2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:54:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c656c351-b711-470e-a1c1-7990455942a7]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:06 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-163053fd-657d-408f-8fa7-2043971d8f1d tempest-GroupSnapshotsTest-990695160 None] group_snapshot 177fe327-dbc7-4609-9805-378188a2ab76: created successfully Sep 08 13:54:06 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 Sep 08 13:54:06 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:07 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74" returned: 0 in 0.458s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f764389-6230-43a6-8091-39108eeb7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:07 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e 1G Sep 08 13:54:07 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:07 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 177fe327-dbc7-4609-9805-378188a2ab76: deleting Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 177fe327-dbc7-4609-9805-378188a2ab76: deleting {{(pid=87262) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-d1befcc3-7113-48ba-93f0-af199c409af5" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-d1befcc3-7113-48ba-93f0-af199c409af5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-2131cf3d-7429-424e-be49-5d9c9bcff1ef" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-2131cf3d-7429-424e-be49-5d9c9bcff1ef" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Deleting offline snapshot 2131cf3d-7429-424e-be49-5d9c9bcff1ef of volume d1befcc3-7113-48ba-93f0-af199c409af5 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] snapshot_file for this snap is: volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3859a9-7680-43f7-8472-703ef16cf2b6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:07 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef Sep 08 13:54:07 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:07 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e 1G" returned: 0 in 0.685s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:07 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e Sep 08 13:54:07 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:08 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef" returned: 0 in 0.453s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1befcc3-7113-48ba-93f0-af199c409af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e8ec77-7951-4935-9a3e-72dabfb65b5a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:08 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e" returned: 0 in 0.424s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:08 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e is being set with open permissions: ugo+rw Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:08 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e Sep 08 13:54:08 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:08 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 Sep 08 13:54:08 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:08 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e" returned: 0 in 0.343s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:08 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5" returned: 0 in 0.489s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:08 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef Sep 08 13:54:08 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e3ba3f08-8bdc-4bab-83da-9581f5e5fbf2 tempest-VolumesSnapshotListTestJSON-849260681 None] Create snapshot completed successfully Sep 08 13:54:08 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef" returned: 0 in 0.370s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:09 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef Sep 08 13:54:09 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:09 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5.2131cf3d-7429-424e-be49-5d9c9bcff1ef" returned: 0 in 0.285s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-2131cf3d-7429-424e-be49-5d9c9bcff1ef" released by "_delete_snapshot" :: held 1.785s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-d1befcc3-7113-48ba-93f0-af199c409af5" released by "delete_snapshot" :: held 1.824s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-c8f5cc37-89a6-4063-9eb0-56d3162506db" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-c8f5cc37-89a6-4063-9eb0-56d3162506db" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Deleting offline snapshot c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 of volume c8f5cc37-89a6-4063-9eb0-56d3162506db {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] snapshot_file for this snap is: volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baa38e9-7873-4ea5-931b-1552dd558ca1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Flow 'volume_create_manager' (d64507ed-2cd2-4405-a7a7-355067149014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e0db2b-f654-4afd-8cfb-325bb2cb6963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:09 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 Sep 08 13:54:09 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e0db2b-f654-4afd-8cfb-325bb2cb6963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-121601480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c97460-eb4a-4fd0-8f31-284b9bf847fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6ff116f9b544688c667b4f9f4d555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:09Z,use_quota=True,user_id='a31f585f7fb14d9abaae26fb38fdf7e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d433a7-faec-473d-a4be-33d1bccecd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d433a7-faec-473d-a4be-33d1bccecd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975646c1-4d4d-4216-bbb6-9380e403f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975646c1-4d4d-4216-bbb6-9380e403f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27c97460-eb4a-4fd0-8f31-284b9bf847fc', 'volume_name': 'volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c45d519-6573-48fe-9b64-613dc8c8c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c45d519-6573-48fe-9b64-613dc8c8c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72039d6d-1b58-4bab-8f70-debb25d10130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:09 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Volume 27c97460-eb4a-4fd0-8f31-284b9bf847fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc', 'volume_size': 1} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-121601480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c97460-eb4a-4fd0-8f31-284b9bf847fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6ff116f9b544688c667b4f9f4d555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:09Z,use_quota=True,user_id='a31f585f7fb14d9abaae26fb38fdf7e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Creating volume 27c97460-eb4a-4fd0-8f31-284b9bf847fc {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:09 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:09 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc 1073741824 Sep 08 13:54:09 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:09 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00" returned: 0 in 0.456s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8f5cc37-89a6-4063-9eb0-56d3162506db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda6b7a2-a784-4708-916e-5b94438815d0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:10 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db Sep 08 13:54:10 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:10 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc 1073741824" returned: 0 in 0.505s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:10 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc Sep 08 13:54:10 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:10 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db" returned: 0 in 0.419s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:10 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 Sep 08 13:54:10 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:10 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.513s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72039d6d-1b58-4bab-8f70-debb25d10130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72463b39-1f1b-455a-bf2b-62411c736f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Creating offline snapshot c5809944-02bc-4e7e-a4ae-2d0e2a45178e of volume 2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09fd360-cb35-4ec0-8a53-bcb6c51af9bc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:10 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Volume volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc (27c97460-eb4a-4fd0-8f31-284b9bf847fc): created successfully Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72463b39-1f1b-455a-bf2b-62411c736f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Flow 'volume_create_manager' (d64507ed-2cd2-4405-a7a7-355067149014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1aab79b3-1bc3-4a83-9861-3e45de3c131d tempest-AbsoluteLimitsTests-1510476023 None] Created volume successfully. Sep 08 13:54:10 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e Sep 08 13:54:10 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:10 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00" returned: 0 in 0.431s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:10 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00 Sep 08 13:54:10 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:11 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e" returned: 0 in 0.433s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f764389-6230-43a6-8091-39108eeb7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:11 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e 1G Sep 08 13:54:11 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:11 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db.c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00" returned: 0 in 0.303s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-c3b690dc-ca79-4ebf-9fa5-7c0cd469ca00" released by "_delete_snapshot" :: held 1.737s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-c8f5cc37-89a6-4063-9eb0-56d3162506db" released by "delete_snapshot" :: held 1.767s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:11 devstack cinder-volume[87262]: WARNING cinder.quota [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1597773158 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1597773158, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:11 devstack cinder-volume[87262]: WARNING cinder.quota [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1597773158 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1597773158, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Created reservations ['ebbe24f8-8040-4f8f-b1b7-dbebef24c67e', '0839f7d8-7047-4a41-99f0-2186a714e062', 'cb1b5cd6-3bba-4ae1-b40d-dc038bd331ed', 'f0982b89-565a-4c58-8724-f7d7cf34e378'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] Created reservations ['2e68d8e2-babe-4471-bae3-41476cf4a30a', '0e4396a4-1e9c-4d19-b7e8-6e79a31b8a04', '7d0ecb95-fb14-4ba0-a131-a7cc81f13d48', 'ef46da91-c3e3-41ae-97f4-17941fd177c2'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-414757c5-e4e7-4e77-9b07-0da1474af284 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 177fe327-dbc7-4609-9805-378188a2ab76: deleted successfully Sep 08 13:54:11 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e 1G" returned: 0 in 0.595s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:11 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e Sep 08 13:54:11 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Acquiring lock "cinder-27c97460-eb4a-4fd0-8f31-284b9bf847fc-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Lock "cinder-27c97460-eb4a-4fd0-8f31-284b9bf847fc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:11 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e" returned: 0 in 0.366s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:11 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e is being set with open permissions: ugo+rw Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Acquiring lock "cinder-quobyte-27c97460-eb4a-4fd0-8f31-284b9bf847fc" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:12 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e Sep 08 13:54:12 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Lock "cinder-quobyte-27c97460-eb4a-4fd0-8f31-284b9bf847fc" acquired by "delete_volume" :: waited 0.042s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee933382-7bf1-434a-8cf4-5b2574af5029]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:12 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc Sep 08 13:54:12 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:12 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e" returned: 0 in 0.312s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:12 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-190a1098-d06a-4406-b81e-5f86dd883970 tempest-VolumesSnapshotListTestJSON-849260681 None] Create snapshot completed successfully Sep 08 13:54:12 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc" returned: 0 in 0.456s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-c8f5cc37-89a6-4063-9eb0-56d3162506db" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:12 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc Sep 08 13:54:12 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-c8f5cc37-89a6-4063-9eb0-56d3162506db" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e023301-2d2c-4f20-9c74-cdbe07419512]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:12 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db Sep 08 13:54:12 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:12 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-27c97460-eb4a-4fd0-8f31-284b9bf847fc" returned: 0 in 0.312s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Lock "cinder-quobyte-27c97460-eb4a-4fd0-8f31-284b9bf847fc" released by "delete_volume" :: held 0.832s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:12 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Created reservations ['5413f18f-dd59-43ce-8487-d03dd5e34774', '0892feb8-95ae-4eab-9034-58853359fde9', '6180a11e-c67b-4731-a423-2bce3d236e8b', 'edcfdc07-3b51-476d-a00e-46f8f1d7b288'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:13 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db" returned: 0 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:13 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:13 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:13 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db Sep 08 13:54:13 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:13 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.344s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Deleted volume successfully. Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fdca42d0-38cb-4e54-a475-14b5c1f56a64 tempest-AbsoluteLimitsTests-1510476023 None] Lock "cinder-27c97460-eb4a-4fd0-8f31-284b9bf847fc-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:13 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c8f5cc37-89a6-4063-9eb0-56d3162506db" returned: 0 in 0.355s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-c8f5cc37-89a6-4063-9eb0-56d3162506db" released by "delete_volume" :: held 0.852s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-d1befcc3-7113-48ba-93f0-af199c409af5" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-d1befcc3-7113-48ba-93f0-af199c409af5" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b46db9-8482-4dcd-bff3-2854e7528dd5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:13 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 Sep 08 13:54:13 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:13 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5" returned: 0 in 0.480s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:14 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5 Sep 08 13:54:14 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:14 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d1befcc3-7113-48ba-93f0-af199c409af5" returned: 0 in 0.380s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-d1befcc3-7113-48ba-93f0-af199c409af5" released by "delete_volume" :: held 0.957s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Created reservations ['d62f6814-ea64-48bc-9f68-c2033f668981'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:14 devstack cinder-volume[87262]: WARNING cinder.quota [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1597773158 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1597773158, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Created reservations ['e0ecc033-fa96-4a6f-84af-9f7c954852b3', '65f712c4-2b81-408f-a9a6-cea9afdc748c', 'f54a2ab1-4645-4f7e-90d2-7e8ed67bb01b', '2af67d6f-0eab-438c-9445-423b3cb1e88e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-c5809944-02bc-4e7e-a4ae-2d0e2a45178e-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-c5809944-02bc-4e7e-a4ae-2d0e2a45178e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-quobyte-c5809944-02bc-4e7e-a4ae-2d0e2a45178e" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Created reservations ['c352f04b-0e4e-474a-b8a6-e16442e93d6e', '3f7cb48a-93a4-4c1d-8338-92cd745b366f', '9bb25323-e9e0-4062-a82c-0f8c6bfabdba', '1f4b92b7-de41-49cb-924a-b87606842d79'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-c5809944-02bc-4e7e-a4ae-2d0e2a45178e" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Deleting offline snapshot c5809944-02bc-4e7e-a4ae-2d0e2a45178e of volume 2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] snapshot_file for this snap is: volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0d6290-b1a5-480d-919f-68ffe98650f3]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:15 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e Sep 08 13:54:15 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:15 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:15 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:15 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.573s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:15 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b8024388-8c7f-4f54-a01b-612196de4e5d tempest-GroupSnapshotsTest-990695160 None] Delete group completed successfully. Sep 08 13:54:15 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e" returned: 0 in 0.785s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f764389-6230-43a6-8091-39108eeb7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92c77cb-a15f-4176-b418-88756821f686]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1280763a-606d-4847-971e-58b0ffbd4269 tempest-GroupSnapshotsTest-990695160 None] Group tempest-GroupSnapshotsTest-Group-198324740: creating Sep 08 13:54:15 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e Sep 08 13:54:15 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1280763a-606d-4847-971e-58b0ffbd4269 tempest-GroupSnapshotsTest-990695160 None] Group tempest-GroupSnapshotsTest-Group-198324740: created successfully Sep 08 13:54:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1280763a-606d-4847-971e-58b0ffbd4269 tempest-GroupSnapshotsTest-990695160 None] Create group completed successfully. Sep 08 13:54:16 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e" returned: 0 in 0.497s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f764389-6230-43a6-8091-39108eeb7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:16 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e Sep 08 13:54:16 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:16 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e" returned: 0 in 0.496s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:16 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e Sep 08 13:54:16 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:16 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.c5809944-02bc-4e7e-a4ae-2d0e2a45178e" returned: 0 in 0.293s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-c5809944-02bc-4e7e-a4ae-2d0e2a45178e" released by "_delete_snapshot" :: held 2.224s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" released by "delete_snapshot" :: held 2.279s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Created reservations ['3fb9066d-9944-4412-ae15-cab73f2aa324', 'cde9d9a1-850f-4e92-80d7-4c4e146ca2a8', '4e164a55-ecec-42b6-8666-848cbfefbbeb', 'ff667dd6-239b-4370-a0bc-31426b3442bb'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Delete snapshot completed successfully. Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3fc9e0e9-f44b-4fa7-9973-e35971e6cae3 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-c5809944-02bc-4e7e-a4ae-2d0e2a45178e-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Flow 'volume_create_manager' (d270e671-c211-4d39-bf81-f4f6494627fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6981d97-a576-4af4-8ff8-71d7830be60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6981d97-a576-4af4-8ff8-71d7830be60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27325647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1025eaa2-8eff-4209-b0cc-1e6117781f8e,host='devstack@QuobyteHD#QuobyteHD',id=33821b4c-4796-4d24-b32e-72584432049f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec843dbc4f478cb0c07a98bf49ab5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:18Z,use_quota=True,user_id='4780d14742ea444286bec3ee3d06ac17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abaf23f2-1372-429d-916c-5267a0148d79),volume_type_id=abaf23f2-1372-429d-916c-5267a0148d79)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6325e5-4f95-490f-b0e2-729630c2c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6325e5-4f95-490f-b0e2-729630c2c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a78f172-f9a7-40b2-98cd-04913a4b7008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a78f172-f9a7-40b2-98cd-04913a4b7008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33821b4c-4796-4d24-b32e-72584432049f', 'volume_name': 'volume-33821b4c-4796-4d24-b32e-72584432049f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb59559-bf95-4b29-85ac-62fdd644e5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb59559-bf95-4b29-85ac-62fdd644e5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcf1730-daeb-49b8-8ad6-74985c04546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:17 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Volume 33821b4c-4796-4d24-b32e-72584432049f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33821b4c-4796-4d24-b32e-72584432049f', 'volume_size': 1} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1025eaa2-8eff-4209-b0cc-1e6117781f8e,created_at=2026-09-08T11:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27325647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1025eaa2-8eff-4209-b0cc-1e6117781f8e,host='devstack@QuobyteHD#QuobyteHD',id=33821b4c-4796-4d24-b32e-72584432049f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec843dbc4f478cb0c07a98bf49ab5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:18Z,use_quota=True,user_id='4780d14742ea444286bec3ee3d06ac17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abaf23f2-1372-429d-916c-5267a0148d79),volume_type_id=abaf23f2-1372-429d-916c-5267a0148d79)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Creating volume 33821b4c-4796-4d24-b32e-72584432049f {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:17 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:17 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f 1073741824 Sep 08 13:54:17 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-faa5718b-a293-4325-b832-11cd8426a44e-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-faa5718b-a293-4325-b832-11cd8426a44e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-quobyte-faa5718b-a293-4325-b832-11cd8426a44e" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-faa5718b-a293-4325-b832-11cd8426a44e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Deleting offline snapshot faa5718b-a293-4325-b832-11cd8426a44e of volume 2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] snapshot_file for this snap is: volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1dad90-17fa-4f75-af71-ab886fdd0641]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:18 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e Sep 08 13:54:18 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:18 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f 1073741824" returned: 0 in 0.627s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:18 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f Sep 08 13:54:18 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:18 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e" returned: 0 in 0.463s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f764389-6230-43a6-8091-39108eeb7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd68e8f-6035-4111-96f8-9c29d76ae5bc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:18 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f" returned: 0 in 0.316s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:18 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 Sep 08 13:54:18 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcf1730-daeb-49b8-8ad6-74985c04546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33821b4c-4796-4d24-b32e-72584432049f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d57e391-1ddf-4c90-8a42-51105f7a16a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:18 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Volume volume-33821b4c-4796-4d24-b32e-72584432049f (33821b4c-4796-4d24-b32e-72584432049f): created successfully Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d57e391-1ddf-4c90-8a42-51105f7a16a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Flow 'volume_create_manager' (d270e671-c211-4d39-bf81-f4f6494627fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-bc84ab5e-7b1a-4077-ad2b-e86b30049d98 tempest-GroupSnapshotsTest-990695160 None] Created volume successfully. Sep 08 13:54:18 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:19 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Flow 'volume_create_manager' (cc06e6d1-a362-4130-9888-d46552de7e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b3a5d0-96aa-44e3-a4a7-1e8bf1281c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74" returned: 0 in 0.468s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f764389-6230-43a6-8091-39108eeb7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:19 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b3a5d0-96aa-44e3-a4a7-1e8bf1281c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-70839477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5339dc-d26a-4236-8f68-230ca9a5d346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170832f93494412f970212e45e45a93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:19Z,use_quota=True,user_id='4b85c5e2769340258357d11d99777698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:19 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9064ce-1b60-463e-b87c-4460418ac1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9064ce-1b60-463e-b87c-4460418ac1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a90b7c-6aad-407e-b2d3-55b31502369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a90b7c-6aad-407e-b2d3-55b31502369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5339dc-d26a-4236-8f68-230ca9a5d346', 'volume_name': 'volume-ce5339dc-d26a-4236-8f68-230ca9a5d346', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b345b2c5-a5e2-4034-ac67-cee3736cb89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b345b2c5-a5e2-4034-ac67-cee3736cb89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89bae64-d777-454f-84a0-1f8e7c0f05d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Volume ce5339dc-d26a-4236-8f68-230ca9a5d346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5339dc-d26a-4236-8f68-230ca9a5d346', 'volume_size': 1} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-70839477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5339dc-d26a-4236-8f68-230ca9a5d346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170832f93494412f970212e45e45a93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:19Z,use_quota=True,user_id='4b85c5e2769340258357d11d99777698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Creating volume ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:19 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:19 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 1073741824 Sep 08 13:54:19 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:19 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e" returned: 0 in 0.429s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:19 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e Sep 08 13:54:19 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:19 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 1073741824" returned: 0 in 0.506s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:19 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 Sep 08 13:54:19 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:19 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.faa5718b-a293-4325-b832-11cd8426a44e" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-faa5718b-a293-4325-b832-11cd8426a44e" released by "_delete_snapshot" :: held 1.798s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" released by "delete_snapshot" :: held 1.822s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Created reservations ['c5c43ebf-fe16-4f88-8d65-28d3b682c9da', 'd0184e67-eec2-4b4a-9088-fac2a729ae86', '8e852b81-43b1-432f-8ba3-36d3261f3412', '1bb4a0d3-a756-4717-b0cc-b906ec831085'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Delete snapshot completed successfully. Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-620c01d0-a43f-4059-9b6a-d256bcaaa5e9 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-faa5718b-a293-4325-b832-11cd8426a44e-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:19 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346" returned: 0 in 0.271s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89bae64-d777-454f-84a0-1f8e7c0f05d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5339dc-d26a-4236-8f68-230ca9a5d346', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef61dd26-183c-45a2-a176-0b46178a981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Volume volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 (ce5339dc-d26a-4236-8f68-230ca9a5d346): created successfully Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef61dd26-183c-45a2-a176-0b46178a981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Flow 'volume_create_manager' (cc06e6d1-a362-4130-9888-d46552de7e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-367b3149-29ef-4ae7-90e3-4fa2cacaa7b3 tempest-VolumesCloneTest-1946251936 None] Created volume successfully. Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-ad71767f-c521-4e7f-88eb-c94c66308d74-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-ad71767f-c521-4e7f-88eb-c94c66308d74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-quobyte-ad71767f-c521-4e7f-88eb-c94c66308d74" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-ad71767f-c521-4e7f-88eb-c94c66308d74" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Deleting offline snapshot ad71767f-c521-4e7f-88eb-c94c66308d74 of volume 2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] snapshot_file for this snap is: volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf863c3f-3ecd-42f0-a8e1-505b5ba89c32]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:20 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 Sep 08 13:54:20 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] GroupSnapshot 2ade9223-ea89-4c0c-a92b-0439780c47cd: creating. Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Group snapshot 2ade9223-ea89-4c0c-a92b-0439780c47cd: creating. {{(pid=87262) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Creating offline snapshot 8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 of volume 33821b4c-4796-4d24-b32e-72584432049f {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b08616-d7f4-417f-8163-d144cc2db71d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:20 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f Sep 08 13:54:20 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:20 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74" returned: 0 in 0.447s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f764389-6230-43a6-8091-39108eeb7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[336bb32b-8e66-4051-844c-3043a637a423]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:20 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 Sep 08 13:54:20 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:20 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f" returned: 0 in 0.430s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:20 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 1G Sep 08 13:54:20 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:21 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887" returned: 0 in 0.418s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:21 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 Sep 08 13:54:21 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:21 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 1G" returned: 0 in 0.499s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33821b4c-4796-4d24-b32e-72584432049f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:21 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33821b4c-4796-4d24-b32e-72584432049f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 Sep 08 13:54:21 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:21 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74" returned: 0 in 0.513s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:21 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74 Sep 08 13:54:21 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:21 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33821b4c-4796-4d24-b32e-72584432049f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088" returned: 0 in 0.373s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:21 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:21 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 Sep 08 13:54:21 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Flow 'volume_create_manager' (e70cbbfc-7557-4797-b61b-70522842879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd35d19f-3dcd-48ba-b1fa-69a09532b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Flow 'volume_create_manager' (d827d30b-a65f-4499-a405-2d0297331270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0887f682-2de4-4173-9b41-e69cc6d8a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd35d19f-3dcd-48ba-b1fa-69a09532b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-615403045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170832f93494412f970212e45e45a93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ce5339dc-d26a-4236-8f68-230ca9a5d346,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:22Z,use_quota=True,user_id='4b85c5e2769340258357d11d99777698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2068ed4d-1736-4db9-b348-44ca96a4194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2068ed4d-1736-4db9-b348-44ca96a4194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c62a7a9-67d6-43b0-a443-2443fea1c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:21 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0887f682-2de4-4173-9b41-e69cc6d8a820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1703079260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2d94d6-85d2-444c-8a7c-aebb37ca6dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8559c29cb64cd39061e95a422747aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:22Z,use_quota=True,user_id='2ad1ecb65fe24bc6a317faa48a0a13f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902d00a3-2ea1-4c5e-b076-e013a73144b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902d00a3-2ea1-4c5e-b076-e013a73144b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c5e5f8-08fc-4441-8b97-2adabbecc067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c5e5f8-08fc-4441-8b97-2adabbecc067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba2d94d6-85d2-444c-8a7c-aebb37ca6dff', 'volume_name': 'volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f635d83b-6c55-4c34-8905-2e1e87507eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f635d83b-6c55-4c34-8905-2e1e87507eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f139cd-f389-4be9-a6c1-f01a388978d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:22 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Volume ba2d94d6-85d2-444c-8a7c-aebb37ca6dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff', 'volume_size': 1} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c62a7a9-67d6-43b0-a443-2443fea1c327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0', 'volume_name': 'volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0', 'volume_size': 2, 'source_volid': 'ce5339dc-d26a-4236-8f68-230ca9a5d346', 'source_volstatus': 'available'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31509d21-e884-4fe3-81ce-16122877ac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31509d21-e884-4fe3-81ce-16122877ac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032f98f3-330d-4914-9da9-b84bf9dbcd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:22 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Volume fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0', 'volume_size': 2, 'source_volid': 'ce5339dc-d26a-4236-8f68-230ca9a5d346', 'source_volstatus': 'available'} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887.ad71767f-c521-4e7f-88eb-c94c66308d74" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:22 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088" returned: 0 in 0.260s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-ad71767f-c521-4e7f-88eb-c94c66308d74" released by "_delete_snapshot" :: held 1.885s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" released by "delete_snapshot" :: held 1.922s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:22 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.info Sep 08 13:54:22 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Created reservations ['423cfb83-d353-4ec8-bd24-1e0810e3cad1', '87875808-0b9e-43b9-985a-49be01bd3b3d', '58917148-fb87-48e2-88a2-fee262c521f1', '20e04bcf-42fc-4828-8bc5-c1b91399c1fa'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Delete snapshot completed successfully. Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d7a87190-4bf5-4295-945c-f49ce4bca8b1 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-ad71767f-c521-4e7f-88eb-c94c66308d74-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:22 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.info" returned: 0 in 0.265s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:22 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:22 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.info Sep 08 13:54:22 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-2f764389-6230-43a6-8091-39108eeb7887-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-2f764389-6230-43a6-8091-39108eeb7887-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:22 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.info" returned: 0 in 0.292s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1703079260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2d94d6-85d2-444c-8a7c-aebb37ca6dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8559c29cb64cd39061e95a422747aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:22Z,use_quota=True,user_id='2ad1ecb65fe24bc6a317faa48a0a13f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Creating volume ba2d94d6-85d2-444c-8a7c-aebb37ca6dff {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:22 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:22 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff 1073741824 Sep 08 13:54:22 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f449db06-96c5-4cca-abe3-29bcf7329685]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-2a063094-cb1c-48cc-a833-ca86e194ced5 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 2ade9223-ea89-4c0c-a92b-0439780c47cd: created successfully Sep 08 13:54:22 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 Sep 08 13:54:22 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:23 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff 1073741824" returned: 0 in 0.491s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:23 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887" returned: 0 in 0.419s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:23 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887 Sep 08 13:54:23 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:23 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff Sep 08 13:54:23 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:23 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2f764389-6230-43a6-8091-39108eeb7887" returned: 0 in 0.251s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-quobyte-2f764389-6230-43a6-8091-39108eeb7887" released by "delete_volume" :: held 0.731s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:23 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.427s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:23 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Cloning volume ce5339dc-d26a-4236-8f68-230ca9a5d346 to volume fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f139cd-f389-4be9-a6c1-f01a388978d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643fdb3e-c037-484f-9b05-47594bc8ef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Creating offline snapshot a15e96b3-421b-449e-b75d-363bc847e380 of volume ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Created reservations ['9357f4f5-cb49-4a1a-b36a-07a53d21d396', '63f68b05-b507-41a8-a21c-fabb64e9ce52', '8e124245-837d-4ba3-a62d-1c288984c048', '36ad521c-085d-4a56-b4c5-89ce0cc83dde'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:23 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Volume volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff (ba2d94d6-85d2-444c-8a7c-aebb37ca6dff): created successfully Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643fdb3e-c037-484f-9b05-47594bc8ef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Flow 'volume_create_manager' (d827d30b-a65f-4499-a405-2d0297331270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cdb3e3-2277-4973-99ff-9e1561aa6557]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4d187cbd-7ceb-4671-a402-424f10544a05 tempest-VolumesTransfersTest-350917292 None] Created volume successfully. Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:23 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:23 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:23 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 Sep 08 13:54:23 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 2ade9223-ea89-4c0c-a92b-0439780c47cd: deleting Sep 08 13:54:24 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.380s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 2ade9223-ea89-4c0c-a92b-0439780c47cd: deleting {{(pid=87262) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 13:54:24 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Deleted volume successfully. Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346" returned: 0 in 0.525s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:24 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 1G Sep 08 13:54:24 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-33821b4c-4796-4d24-b32e-72584432049f" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a05d4e5e-f8d9-4dc7-af00-9a0fc6602f49 tempest-VolumesSnapshotListTestJSON-849260681 None] Lock "cinder-2f764389-6230-43a6-8091-39108eeb7887-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-33821b4c-4796-4d24-b32e-72584432049f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-8efa3f96-c0c4-4f28-b34e-1b15c4f8e088" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-8efa3f96-c0c4-4f28-b34e-1b15c4f8e088" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Deleting offline snapshot 8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 of volume 33821b4c-4796-4d24-b32e-72584432049f {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] snapshot_file for this snap is: volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[baadde03-e286-4280-a08e-b80d86ce834a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:24 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 Sep 08 13:54:24 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:24 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 1G" returned: 0 in 0.540s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:24 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 Sep 08 13:54:24 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:24 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088" returned: 0 in 0.452s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33821b4c-4796-4d24-b32e-72584432049f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3ae7c6-e1cc-4e3e-8bb1-68bd3f215936]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:24 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f Sep 08 13:54:24 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:25 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380" returned: 0 in 0.386s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:25 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 is being set with open permissions: ugo+rw Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:25 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 Sep 08 13:54:25 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4720e5ff-0434-44cd-aeb8-6b6a9ad2b860 tempest-VolumesTransfersTest-38338769 None] Transfer volume completed successfully. Sep 08 13:54:25 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f" returned: 0 in 0.497s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:25 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 Sep 08 13:54:25 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:25 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380" returned: 0 in 0.410s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:25 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.info Sep 08 13:54:25 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:25 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088" returned: 0 in 0.427s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:25 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088 Sep 08 13:54:25 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:25 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.info" returned: 0 in 0.332s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:25 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.info is being set with open permissions: ugo+rw Sep 08 13:54:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:25 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.info Sep 08 13:54:25 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Acquiring lock "cinder-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Lock "cinder-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:26 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f.8efa3f96-c0c4-4f28-b34e-1b15c4f8e088" returned: 0 in 0.330s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-8efa3f96-c0c4-4f28-b34e-1b15c4f8e088" released by "_delete_snapshot" :: held 1.860s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-33821b4c-4796-4d24-b32e-72584432049f" released by "delete_snapshot" :: held 1.902s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Acquiring lock "cinder-quobyte-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Lock "cinder-quobyte-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[58047b02-3aec-4385-b613-65015a966540]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:26 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.info" returned: 0 in 0.389s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Acquiring lock "cinder-quobyte-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Lock "cinder-quobyte-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] snapshot: a15e96b3-421b-449e-b75d-363bc847e380, volume: fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ca4fde-f959-4043-8e17-dde3241fc3c7]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:26 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff Sep 08 13:54:26 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:26 devstack cinder-volume[87262]: WARNING cinder.quota [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1590872469 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1590872469, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:26 devstack cinder-volume[87262]: WARNING cinder.quota [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1590872469 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1590872469, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] Created reservations ['c8b159ab-1ff4-4a39-810a-87fc873abe18', 'e818bc24-5b30-49a1-8963-ba4ff9cef803', '8aa604a8-2acc-4a49-944a-d9ba2adc3521', '32f4e278-8649-4d8e-8ddb-066d183a9cae'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ceda9e6c-21d9-4cfd-aefa-19890a503a18 tempest-GroupSnapshotsTest-990695160 None] group_snapshot 2ade9223-ea89-4c0c-a92b-0439780c47cd: deleted successfully Sep 08 13:54:26 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 Sep 08 13:54:26 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:26 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff" returned: 0 in 0.415s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:26 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff Sep 08 13:54:26 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:26 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380" returned: 0 in 0.418s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce5339dc-d26a-4236-8f68-230ca9a5d346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca923f4-8e40-442c-9c8e-ae6f3ebdd96e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:26 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff" returned: 0 in 0.267s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:26 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 Sep 08 13:54:26 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Lock "cinder-quobyte-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff" released by "delete_volume" :: held 0.745s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:26 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Created reservations ['efaff46d-357e-4457-bb20-fbe0b1c21ffc', 'e4daa4ec-5563-4c6f-ae34-c187e2e3959b', '3e8960d0-843c-4cba-a5e1-907a12e21f28', '61e7ab38-9e55-446c-b932-4c4ac55b2c4d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:27 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:27 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:27 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346" returned: 0 in 0.457s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:27 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 Sep 08 13:54:27 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:27 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.312s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Deleted volume successfully. Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5bf84e6f-bdc7-4498-b460-4074a7e969f2 tempest-VolumesTransfersTest-241085576 None] Lock "cinder-ba2d94d6-85d2-444c-8a7c-aebb37ca6dff-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "cinder-quobyte-33821b4c-4796-4d24-b32e-72584432049f" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-33821b4c-4796-4d24-b32e-72584432049f" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ab4f47-15fc-47c8-837f-69a107b0df15]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Flow 'volume_create_manager' (a290f18e-2a01-44ec-8ae4-1b4aa0c18b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf97ca-0ba2-4941-ae70-7a4d69cda3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf97ca-0ba2-4941-ae70-7a4d69cda3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-363254062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbea71e-cd6c-4b80-8e07-5e90d634a965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8559c29cb64cd39061e95a422747aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:28Z,use_quota=True,user_id='2ad1ecb65fe24bc6a317faa48a0a13f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9822e2a4-e98d-4da4-abe4-945351b566e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9822e2a4-e98d-4da4-abe4-945351b566e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed85f69-debb-41f8-863f-0f557d30b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed85f69-debb-41f8-863f-0f557d30b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbea71e-cd6c-4b80-8e07-5e90d634a965', 'volume_name': 'volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fb1b2f-45ea-44d7-8bcc-422e7224dcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fb1b2f-45ea-44d7-8bcc-422e7224dcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e3e1b8-a1e0-49c2-bbeb-b01bbdf4571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:28 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Volume ecbea71e-cd6c-4b80-8e07-5e90d634a965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965', 'volume_size': 1} Sep 08 13:54:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:28 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f Sep 08 13:54:28 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:29 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f" returned: 0 in 1.024s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:29 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f Sep 08 13:54:29 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:29 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33821b4c-4796-4d24-b32e-72584432049f" returned: 0 in 0.737s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Lock "cinder-quobyte-33821b4c-4796-4d24-b32e-72584432049f" released by "delete_volume" :: held 1.949s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Created reservations ['12047e0c-c873-41d3-b562-34d936693191'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:30 devstack cinder-volume[87262]: WARNING cinder.quota [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1590872469 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1590872469, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Created reservations ['6a559a35-1535-4560-98b3-80010773ad43', '8267c8d7-7355-4a27-bfaf-fbe76e5e45a0', '1e46d877-9e8b-4f40-bbcc-426ca144d599', '08220832-530a-4c3b-8024-ba86610c0b67'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:30 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:30 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:31 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.771s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:31 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cdab7c36-f99a-41e6-8df7-c3699ae6bf4b tempest-GroupSnapshotsTest-990695160 None] Delete group completed successfully. Sep 08 13:54:33 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" returned: 0 in 5.994s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:54:33 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Converted 1024.00 MB image at 170.81 MB/s Sep 08 13:54:33 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 is being set with open permissions: ugo+rw Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:33 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 Sep 08 13:54:33 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:33 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" returned: 0 in 0.273s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Lock "cinder-quobyte-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" released by "_copy_volume_from_snapshot" :: held 7.228s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Acquiring lock "cinder-quobyte-a15e96b3-421b-449e-b75d-363bc847e380" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Lock "cinder-quobyte-a15e96b3-421b-449e-b75d-363bc847e380" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Deleting offline snapshot a15e96b3-421b-449e-b75d-363bc847e380 of volume ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] snapshot_file for this snap is: volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e16a19f-6449-4116-825a-ff451da82a1c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:33 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 Sep 08 13:54:33 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:34 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380" returned: 0 in 0.418s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce5339dc-d26a-4236-8f68-230ca9a5d346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:34 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedf3b85-9034-41ac-bcde-8e2a55a667a1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:34 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 Sep 08 13:54:34 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:34 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346" returned: 0 in 0.608s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:34 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 Sep 08 13:54:34 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:35 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380" returned: 0 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:35 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380 Sep 08 13:54:35 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:35 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346.a15e96b3-421b-449e-b75d-363bc847e380" returned: 0 in 0.272s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Lock "cinder-quobyte-a15e96b3-421b-449e-b75d-363bc847e380" released by "_delete_snapshot" :: held 1.827s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.916s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.073s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-363254062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbea71e-cd6c-4b80-8e07-5e90d634a965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8559c29cb64cd39061e95a422747aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:28Z,use_quota=True,user_id='2ad1ecb65fe24bc6a317faa48a0a13f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Creating volume ecbea71e-cd6c-4b80-8e07-5e90d634a965 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:35 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032f98f3-330d-4914-9da9-b84bf9dbcd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0', 'volume_size': 2, 'source_volid': 'ce5339dc-d26a-4236-8f68-230ca9a5d346', 'source_volstatus': 'available'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:35 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 1073741824 Sep 08 13:54:35 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40e4985-de86-466c-bbc4-6e8287513e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:35 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Volume volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 (fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0): created successfully Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40e4985-de86-466c-bbc4-6e8287513e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Flow 'volume_create_manager' (e70cbbfc-7557-4797-b61b-70522842879f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:35 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b855da36-e8fd-4937-ad46-f194b03caa12 tempest-VolumesCloneTest-1946251936 None] Created volume successfully. Sep 08 13:54:36 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 1073741824" returned: 0 in 0.648s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:36 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 Sep 08 13:54:36 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:36 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965" returned: 0 in 0.420s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e3e1b8-a1e0-49c2-bbeb-b01bbdf4571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9f7da2-5bd6-4a22-8cce-c0232a1aa33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:36 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Volume volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 (ecbea71e-cd6c-4b80-8e07-5e90d634a965): created successfully Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9f7da2-5bd6-4a22-8cce-c0232a1aa33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Flow 'volume_create_manager' (a290f18e-2a01-44ec-8ae4-1b4aa0c18b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-bb14ebff-6e90-4e1f-aad8-3a0604a2be5a tempest-VolumesTransfersTest-350917292 None] Created volume successfully. Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Acquiring lock "cinder-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Lock "cinder-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Acquiring lock "cinder-quobyte-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Lock "cinder-quobyte-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc001da9-c067-459e-aa30-c9c23f199d9e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:37 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 Sep 08 13:54:37 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Acquiring lock "cinder-ecbea71e-cd6c-4b80-8e07-5e90d634a965-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Lock "cinder-ecbea71e-cd6c-4b80-8e07-5e90d634a965-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Acquiring lock "cinder-quobyte-ecbea71e-cd6c-4b80-8e07-5e90d634a965" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Lock "cinder-quobyte-ecbea71e-cd6c-4b80-8e07-5e90d634a965" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:37 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" returned: 0 in 0.512s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b3297f-4491-4168-a8e1-9b4bced2a5b4]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:37 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0 Sep 08 13:54:37 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:37 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 Sep 08 13:54:37 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:37 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" returned: 0 in 0.296s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Lock "cinder-quobyte-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0" released by "delete_volume" :: held 0.865s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:37 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Created reservations ['20f8c005-c709-4c6d-85bd-1a2a9a456fe4', '3e74b12e-f021-4598-b9b9-c64c1a056aa0', '35ae2d39-ab54-47b6-9b6b-abf00da3af2f', 'af935494-6199-4284-929a-35dc08de6c99'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:38 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965" returned: 0 in 0.586s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:38 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:38 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:38 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965 Sep 08 13:54:38 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Acquiring lock "cinder-ce5339dc-d26a-4236-8f68-230ca9a5d346-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Lock "cinder-ce5339dc-d26a-4236-8f68-230ca9a5d346-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Acquiring lock "cinder-quobyte-ce5339dc-d26a-4236-8f68-230ca9a5d346" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Lock "cinder-quobyte-ce5339dc-d26a-4236-8f68-230ca9a5d346" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8b436-8974-4736-a3c1-f3fb593eceec]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:38 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.475s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:38 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecbea71e-cd6c-4b80-8e07-5e90d634a965" returned: 0 in 0.453s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Deleted volume successfully. Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Lock "cinder-quobyte-ecbea71e-cd6c-4b80-8e07-5e90d634a965" released by "delete_volume" :: held 1.125s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:38 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 Sep 08 13:54:38 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-56e078cd-4593-4ba8-9722-42a258e36a0e tempest-VolumesCloneTest-1946251936 None] Lock "cinder-fc9ed4c2-dc9c-4317-a634-2e680ab3d3d0-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Created reservations ['7a4366e6-bd12-4031-a8fd-945fecf7502a', '26b71968-06c6-4d70-83fd-e6e65a37853d', '98b571ee-153b-4a78-8cfa-6379bf6ec406', '3d205a05-4c55-41b0-9a43-9e73a673f2da'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:38 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:38 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:39 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346" returned: 0 in 0.505s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:39 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346 Sep 08 13:54:39 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:39 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.407s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:39 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Deleted volume successfully. Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b0b6249c-4177-4577-8bcc-5bb25aabf6e0 tempest-VolumesTransfersTest-241085576 None] Lock "cinder-ecbea71e-cd6c-4b80-8e07-5e90d634a965-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:39 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ce5339dc-d26a-4236-8f68-230ca9a5d346" returned: 0 in 0.377s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Lock "cinder-quobyte-ce5339dc-d26a-4236-8f68-230ca9a5d346" released by "delete_volume" :: held 0.984s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Created reservations ['de9b4c4e-1f87-4712-bc24-f125c0f9e7b1', 'ff97bc4b-24a5-43ef-b17f-910ce3a0154a', 'a5a2596e-ebe4-450e-913e-26eddd7c3c8d', '6bfd134f-83a1-4b62-b9f8-f5593466383c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:39 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:39 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:39 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.300s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:39 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Deleted volume successfully. Sep 08 13:54:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85edc3d3-a545-4730-a7ab-48d0f8ef603d tempest-VolumesCloneTest-1946251936 None] Lock "cinder-ce5339dc-d26a-4236-8f68-230ca9a5d346-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6978c290-498e-4bb9-a2fe-22507512aa63 tempest-GroupSnapshotsV319Test-921480161 None] Group tempest-GroupSnapshotsV319Test-Group-1660612491: creating Sep 08 13:54:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6978c290-498e-4bb9-a2fe-22507512aa63 tempest-GroupSnapshotsV319Test-921480161 None] Group tempest-GroupSnapshotsV319Test-Group-1660612491: created successfully Sep 08 13:54:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6978c290-498e-4bb9-a2fe-22507512aa63 tempest-GroupSnapshotsV319Test-921480161 None] Create group completed successfully. Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Flow 'volume_create_manager' (a27b6326-da84-4ecb-a73c-c2e247dbafda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e69ce0c-1927-4d72-a66d-244b68eabfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e69ce0c-1927-4d72-a66d-244b68eabfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2102534055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2867e57-e200-437c-8d69-f1511c965a9b,host='devstack@QuobyteHD#QuobyteHD',id=6e6e726c-2b29-4e75-af12-db9c67cd4ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c646e6e1349420ba76cfe92646a103e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:42Z,use_quota=True,user_id='8c47c20fd509421eaaa2a5290be99087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56835a5b-7e57-4acf-8e4a-0a0d58ecfcaf),volume_type_id=56835a5b-7e57-4acf-8e4a-0a0d58ecfcaf)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dc3acc-88c5-46f4-8e4f-59049854bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dc3acc-88c5-46f4-8e4f-59049854bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe02b0b-1d41-4f5a-9d50-d28908658662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe02b0b-1d41-4f5a-9d50-d28908658662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6e726c-2b29-4e75-af12-db9c67cd4ee5', 'volume_name': 'volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271076f8-fafb-4078-ac6d-e16b97a0aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271076f8-fafb-4078-ac6d-e16b97a0aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b2b969-9b96-400b-bbc5-7181031a2d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:41 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Volume 6e6e726c-2b29-4e75-af12-db9c67cd4ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5', 'volume_size': 1} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a2867e57-e200-437c-8d69-f1511c965a9b,created_at=2026-09-08T11:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2102534055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2867e57-e200-437c-8d69-f1511c965a9b,host='devstack@QuobyteHD#QuobyteHD',id=6e6e726c-2b29-4e75-af12-db9c67cd4ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c646e6e1349420ba76cfe92646a103e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:42Z,use_quota=True,user_id='8c47c20fd509421eaaa2a5290be99087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56835a5b-7e57-4acf-8e4a-0a0d58ecfcaf),volume_type_id=56835a5b-7e57-4acf-8e4a-0a0d58ecfcaf)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Creating volume 6e6e726c-2b29-4e75-af12-db9c67cd4ee5 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:41 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:41 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 1073741824 Sep 08 13:54:41 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:42 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 1073741824" returned: 0 in 0.543s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:42 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 Sep 08 13:54:42 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:42 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" returned: 0 in 0.309s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b2b969-9b96-400b-bbc5-7181031a2d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41485d78-4c24-47f4-8d71-def1dec20f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:42 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Volume volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 (6e6e726c-2b29-4e75-af12-db9c67cd4ee5): created successfully Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41485d78-4c24-47f4-8d71-def1dec20f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Flow 'volume_create_manager' (a27b6326-da84-4ecb-a73c-c2e247dbafda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-56391676-77b9-4001-b49b-21b37a39fe5e tempest-GroupSnapshotsV319Test-921480161 None] Created volume successfully. Sep 08 13:54:43 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] GroupSnapshot 98f3083c-8900-44fc-baa4-2612589884d5: creating. Sep 08 13:54:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Group snapshot 98f3083c-8900-44fc-baa4-2612589884d5: creating. {{(pid=87262) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 13:54:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Creating offline snapshot 42667cb7-f2c3-46cf-9f53-3b13541ec685 of volume 6e6e726c-2b29-4e75-af12-db9c67cd4ee5 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:54:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d33bd0-c7e6-40eb-9349-1af3855066fa]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:43 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 Sep 08 13:54:43 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:43 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" returned: 0 in 0.484s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:44 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 1G Sep 08 13:54:44 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:44 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 1G" returned: 0 in 0.646s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:44 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 Sep 08 13:54:44 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:44 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685" returned: 0 in 0.334s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:44 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:54:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:45 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 Sep 08 13:54:45 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:45 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:45 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.info Sep 08 13:54:45 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:45 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.info" returned: 0 in 0.349s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:45 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:54:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:45 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.info Sep 08 13:54:45 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:46 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.info" returned: 0 in 0.439s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:46 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-16237a09-5e16-4497-b4b2-718737fdebe1 tempest-GroupSnapshotsV319Test-921480161 None] group_snapshot 98f3083c-8900-44fc-baa4-2612589884d5: created successfully Sep 08 13:54:47 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] group_snapshot 98f3083c-8900-44fc-baa4-2612589884d5: deleting Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] group_snapshot 98f3083c-8900-44fc-baa4-2612589884d5: deleting {{(pid=87262) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Acquiring lock "cinder-quobyte-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Lock "cinder-quobyte-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Acquiring lock "cinder-quobyte-42667cb7-f2c3-46cf-9f53-3b13541ec685" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Lock "cinder-quobyte-42667cb7-f2c3-46cf-9f53-3b13541ec685" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Deleting offline snapshot 42667cb7-f2c3-46cf-9f53-3b13541ec685 of volume 6e6e726c-2b29-4e75-af12-db9c67cd4ee5 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] snapshot_file for this snap is: volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe53534-e905-45af-8a74-05cca2c86b40]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Flow 'volume_create_manager' (aa81ee65-4755-4808-8126-e28df20bfe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:47 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eef2a18-2c71-461b-83d6-d077da5deb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:47 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eef2a18-2c71-461b-83d6-d077da5deb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-910357731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be60a78-37e1-4f31-883b-b4fd47691f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce356d30dedc435a9890ba1f5a928b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:48Z,use_quota=True,user_id='1eec351e913e47b484917b6344310e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464c394b-f17d-4ef3-9292-8e6df629e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464c394b-f17d-4ef3-9292-8e6df629e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35d754b-fa92-494d-8053-5ce8a757c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35d754b-fa92-494d-8053-5ce8a757c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be60a78-37e1-4f31-883b-b4fd47691f21', 'volume_name': 'volume-1be60a78-37e1-4f31-883b-b4fd47691f21', 'volume_size': 2}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60f9048-4511-4ab2-9cef-21e7ae1f4934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60f9048-4511-4ab2-9cef-21e7ae1f4934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc83a45-375c-4a19-931f-028d5cf7c792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:47 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Volume 1be60a78-37e1-4f31-883b-b4fd47691f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be60a78-37e1-4f31-883b-b4fd47691f21', 'volume_size': 2} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-910357731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be60a78-37e1-4f31-883b-b4fd47691f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce356d30dedc435a9890ba1f5a928b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:48Z,use_quota=True,user_id='1eec351e913e47b484917b6344310e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Creating volume 1be60a78-37e1-4f31-883b-b4fd47691f21 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:47 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 2147483648 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:47 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 2147483648 Sep 08 13:54:47 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:47 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685" returned: 0 in 0.572s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4a648-6acb-4539-8c6d-9f1ddedcd631]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:48 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 Sep 08 13:54:48 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:48 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 2147483648" returned: 0 in 0.549s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:48 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 Sep 08 13:54:48 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:48 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" returned: 0 in 0.495s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:48 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 Sep 08 13:54:48 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:48 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21" returned: 0 in 0.352s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc83a45-375c-4a19-931f-028d5cf7c792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be60a78-37e1-4f31-883b-b4fd47691f21', 'volume_size': 2}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba01b21-612b-4fcc-a3cb-c1f6c6f66dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:48 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Volume volume-1be60a78-37e1-4f31-883b-b4fd47691f21 (1be60a78-37e1-4f31-883b-b4fd47691f21): created successfully Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba01b21-612b-4fcc-a3cb-c1f6c6f66dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Flow 'volume_create_manager' (aa81ee65-4755-4808-8126-e28df20bfe1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f267c4e4-be1f-4404-b214-cde5812553d6 tempest-VolumesCloneNegativeTest-1832881457 None] Created volume successfully. Sep 08 13:54:48 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685" returned: 0 in 0.463s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:48 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685 Sep 08 13:54:48 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:49 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5.42667cb7-f2c3-46cf-9f53-3b13541ec685" returned: 0 in 0.322s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Lock "cinder-quobyte-42667cb7-f2c3-46cf-9f53-3b13541ec685" released by "_delete_snapshot" :: held 2.001s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Lock "cinder-quobyte-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" released by "delete_snapshot" :: held 2.045s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:49 devstack cinder-volume[87262]: WARNING cinder.quota [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-68029578 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-68029578, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:49 devstack cinder-volume[87262]: WARNING cinder.quota [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-68029578 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-68029578, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:49 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] Created reservations ['13b0d114-5df7-4906-9857-5196cbb07d26', '9757511b-fb81-44e4-a12d-20312549fb96', '90499312-a086-4ab4-b657-c4acc103b194', '5251fdc7-073b-4f4e-819e-fe9d65a0d20b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:49 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a5484949-cf98-487b-8071-ce6f7f162dca tempest-GroupSnapshotsV319Test-921480161 None] group_snapshot 98f3083c-8900-44fc-baa4-2612589884d5: deleted successfully Sep 08 13:54:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Acquiring lock "cinder-1be60a78-37e1-4f31-883b-b4fd47691f21-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "cinder-1be60a78-37e1-4f31-883b-b4fd47691f21-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Acquiring lock "cinder-quobyte-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Lock "cinder-quobyte-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" acquired by "delete_volume" :: waited 0.055s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Acquiring lock "cinder-quobyte-1be60a78-37e1-4f31-883b-b4fd47691f21" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "cinder-quobyte-1be60a78-37e1-4f31-883b-b4fd47691f21" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb9425e-3e5c-49d8-b3d2-02cb4b3a2890]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a29b94-3e75-4879-addb-70defea8027c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:50 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 Sep 08 13:54:50 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:50 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 Sep 08 13:54:50 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:50 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" returned: 0 in 0.552s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:50 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5 Sep 08 13:54:50 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:50 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21" returned: 0 in 0.629s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:50 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21 Sep 08 13:54:50 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:50 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" returned: 0 in 0.311s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Lock "cinder-quobyte-6e6e726c-2b29-4e75-af12-db9c67cd4ee5" released by "delete_volume" :: held 0.982s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Created reservations ['6941d314-2a93-4d14-ae7e-8db37b23395d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:51 devstack cinder-volume[87262]: WARNING cinder.quota [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-68029578 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-68029578, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Created reservations ['04783027-42f9-42de-bfb8-c4d4c54f5bf9', 'c7210c94-18db-458c-a6b3-d8c7cb2b5cf2', '23ec5b90-dd17-4b05-9eae-e0a3ac929b75', '6a8bc933-4404-4a49-a66d-c547e7bb4ae6'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:51 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1be60a78-37e1-4f31-883b-b4fd47691f21" returned: 0 in 0.448s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "cinder-quobyte-1be60a78-37e1-4f31-883b-b4fd47691f21" released by "delete_volume" :: held 1.171s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Created reservations ['1f35aa69-cfe4-4fdd-9fea-becafb4c77b0', '368324d7-a502-43c5-ac93-13a3de0d4760', 'eddca59f-5849-4483-a154-cbf01d0ea117', '917fa8f1-c571-494d-8b39-d0518be02847'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:51 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:51 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:51 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:51 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:51 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.295s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-790c4777-6a45-462d-9b96-a5b21ce460b5 tempest-GroupSnapshotsV319Test-921480161 None] Delete group completed successfully. Sep 08 13:54:51 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.308s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Deleted volume successfully. Sep 08 13:54:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ee5062-8d51-49c9-8aff-2423c117a862 tempest-VolumesCloneNegativeTest-1832881457 None] Lock "cinder-1be60a78-37e1-4f31-883b-b4fd47691f21-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Flow 'volume_create_manager' (744921c1-0299-404a-9178-96b4633ec1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5351c95-c205-4ae9-a4e8-71aad06b7856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5351c95-c205-4ae9-a4e8-71aad06b7856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1637325400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b3db95-7e2e-41fa-82ec-e8f37784f019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddde688a45234cddbde20535f374474d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:52Z,use_quota=True,user_id='e03be6a0cff84808873d82e2668424d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01d5436-5fa0-4ecc-b2f8-308bc36364f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01d5436-5fa0-4ecc-b2f8-308bc36364f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5310cc96-c87e-4e4b-9061-8c92c0411147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5310cc96-c87e-4e4b-9061-8c92c0411147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b3db95-7e2e-41fa-82ec-e8f37784f019', 'volume_name': 'volume-21b3db95-7e2e-41fa-82ec-e8f37784f019', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f546f5-2f20-423e-8b9c-f8df2f09beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f546f5-2f20-423e-8b9c-f8df2f09beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d52dee0-e5a0-4b64-9e37-0eb8e1a66bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:52 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Volume 21b3db95-7e2e-41fa-82ec-e8f37784f019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b3db95-7e2e-41fa-82ec-e8f37784f019', 'volume_size': 1} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1637325400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b3db95-7e2e-41fa-82ec-e8f37784f019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddde688a45234cddbde20535f374474d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:52Z,use_quota=True,user_id='e03be6a0cff84808873d82e2668424d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Creating volume 21b3db95-7e2e-41fa-82ec-e8f37784f019 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:52 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:52 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 1073741824 Sep 08 13:54:52 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:52 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 1073741824" returned: 0 in 0.624s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:53 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 Sep 08 13:54:53 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:53 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019" returned: 0 in 0.355s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d52dee0-e5a0-4b64-9e37-0eb8e1a66bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b3db95-7e2e-41fa-82ec-e8f37784f019', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9bbebc-ae92-4769-92a0-ffa6235f8bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:53 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Volume volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 (21b3db95-7e2e-41fa-82ec-e8f37784f019): created successfully Sep 08 13:54:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9bbebc-ae92-4769-92a0-ffa6235f8bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Flow 'volume_create_manager' (744921c1-0299-404a-9178-96b4633ec1b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:53 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7976edee-0d4c-4ce4-b1da-c53499d71464 tempest-VolumesTransfersV355Test-443788361 None] Created volume successfully. Sep 08 13:54:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9cbcf5b8-f5f1-442a-8774-e1336e2bf1b8 tempest-VolumesTransfersV355Test-961522109 None] Transfer volume completed successfully. Sep 08 13:54:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Acquiring lock "cinder-21b3db95-7e2e-41fa-82ec-e8f37784f019-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Lock "cinder-21b3db95-7e2e-41fa-82ec-e8f37784f019-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Acquiring lock "cinder-quobyte-21b3db95-7e2e-41fa-82ec-e8f37784f019" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:54:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Lock "cinder-quobyte-21b3db95-7e2e-41fa-82ec-e8f37784f019" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:54:56 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb57876-21b6-41d5-bdab-324171102c74]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:54:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:56 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 Sep 08 13:54:56 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:56 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019" returned: 0 in 0.412s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:57 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019 Sep 08 13:54:57 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:57 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-21b3db95-7e2e-41fa-82ec-e8f37784f019" returned: 0 in 0.302s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Lock "cinder-quobyte-21b3db95-7e2e-41fa-82ec-e8f37784f019" released by "delete_volume" :: held 0.783s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Created reservations ['33191e19-818a-435f-8f34-b3966bd81f5c', '02fd77ec-1689-49e3-b8bd-43757a18ff46', 'be4a1096-326f-4b53-b9c8-5b3a2babb7e9', '9dc1829c-5956-42f9-991b-ccef9495b52a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:57 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:54:57 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:58 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.496s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:54:58 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Deleted volume successfully. Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4d58344-2307-4ee4-8ed2-1ae91cbfb32d tempest-VolumesTransfersV355Test-1956888380 None] Lock "cinder-21b3db95-7e2e-41fa-82ec-e8f37784f019-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (5f36c4eb-d69f-478e-939b-bd8693f18383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aef11c9-a345-4b7f-9df5-381215991d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aef11c9-a345-4b7f-9df5-381215991d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129149750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d377ef28-c252-4f5e-8fa6-86f7a7e98ca2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:58Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034cd5dd-b9ca-4113-8cea-6cf63c4d5538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034cd5dd-b9ca-4113-8cea-6cf63c4d5538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a77d7f0-8a34-4e00-a68e-c156060a2cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a77d7f0-8a34-4e00-a68e-c156060a2cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd377ef28-c252-4f5e-8fa6-86f7a7e98ca2', 'volume_name': 'volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4703dbb2-4887-490d-99b7-f1991ae57927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4703dbb2-4887-490d-99b7-f1991ae57927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a3ebe7-9739-4679-908d-9049c7ce1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Volume d377ef28-c252-4f5e-8fa6-86f7a7e98ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2', 'volume_size': 1} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129149750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d377ef28-c252-4f5e-8fa6-86f7a7e98ca2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:58Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Creating volume d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:58 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:58 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 1073741824 Sep 08 13:54:58 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Flow 'volume_create_manager' (a171fdbc-3c0e-49e6-8484-687eb9bbacaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044f185b-d33d-42a5-960e-eba3a600d520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044f185b-d33d-42a5-960e-eba3a600d520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1621473724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95201407-92a9-4869-af14-2e2bb316ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddde688a45234cddbde20535f374474d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:59Z,use_quota=True,user_id='e03be6a0cff84808873d82e2668424d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e49c9a7-809d-4e4a-995d-d800b3256053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e49c9a7-809d-4e4a-995d-d800b3256053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b72892-351d-49dd-96ba-ba0fa2a298ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b72892-351d-49dd-96ba-ba0fa2a298ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95201407-92a9-4869-af14-2e2bb316ddb4', 'volume_name': 'volume-95201407-92a9-4869-af14-2e2bb316ddb4', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c1b1b7-4bcd-4ab6-86d2-48617099111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c1b1b7-4bcd-4ab6-86d2-48617099111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53462d0e-cd3f-4850-beb5-efe7e90985fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:58 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Volume 95201407-92a9-4869-af14-2e2bb316ddb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95201407-92a9-4869-af14-2e2bb316ddb4', 'volume_size': 1} Sep 08 13:54:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:59 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 1073741824" returned: 0 in 0.571s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:59 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 Sep 08 13:54:59 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:59 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2" returned: 0 in 0.283s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1621473724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95201407-92a9-4869-af14-2e2bb316ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddde688a45234cddbde20535f374474d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:54:59Z,use_quota=True,user_id='e03be6a0cff84808873d82e2668424d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Creating volume 95201407-92a9-4869-af14-2e2bb316ddb4 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:54:59 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:59 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 1073741824 Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a3ebe7-9739-4679-908d-9049c7ce1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:59 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ef27ba-045b-4e0c-9978-ba26585f2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:54:59 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Volume volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 (d377ef28-c252-4f5e-8fa6-86f7a7e98ca2): created successfully Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ef27ba-045b-4e0c-9978-ba26585f2929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (5f36c4eb-d69f-478e-939b-bd8693f18383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:54:59 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d232f49d-2d31-4755-8250-0285fafa3440 tempest-VolumesGetTest-372354448 None] Created volume successfully. Sep 08 13:54:59 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 1073741824" returned: 0 in 0.484s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:54:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:54:59 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 Sep 08 13:54:59 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:00 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4" returned: 0 in 0.312s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53462d0e-cd3f-4850-beb5-efe7e90985fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95201407-92a9-4869-af14-2e2bb316ddb4', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c032ffc-5750-44c6-90b4-9f9e726d68db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:00 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Volume volume-95201407-92a9-4869-af14-2e2bb316ddb4 (95201407-92a9-4869-af14-2e2bb316ddb4): created successfully Sep 08 13:55:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c032ffc-5750-44c6-90b4-9f9e726d68db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Flow 'volume_create_manager' (a171fdbc-3c0e-49e6-8484-687eb9bbacaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8a583515-e4a2-4edc-b7be-e66325b2295f tempest-GroupsV314Test-863888367 None] Group tempest-GroupsV314Test-Group-162727619: creating Sep 08 13:55:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e525ca1b-799a-4783-9644-2ad2a71401f3 tempest-VolumesTransfersV355Test-443788361 None] Created volume successfully. Sep 08 13:55:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8a583515-e4a2-4edc-b7be-e66325b2295f tempest-GroupsV314Test-863888367 None] Group tempest-GroupsV314Test-Group-162727619: created successfully Sep 08 13:55:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8a583515-e4a2-4edc-b7be-e66325b2295f tempest-GroupsV314Test-863888367 None] Create group completed successfully. Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Acquiring lock "cinder-95201407-92a9-4869-af14-2e2bb316ddb4-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Lock "cinder-95201407-92a9-4869-af14-2e2bb316ddb4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (c64fce0b-be39-40fb-85b6-4943b91f4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8e91cb-7ca7-462f-851c-f56fbf3816ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8e91cb-7ca7-462f-851c-f56fbf3816ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1893658862',display_name='tempest-VolumesGetTest-Volume-1966772247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:01Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388931be-7bce-4328-9ec1-082d3924b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388931be-7bce-4328-9ec1-082d3924b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d2472b-bbaf-4359-8dd9-ace312e78fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d2472b-bbaf-4359-8dd9-ace312e78fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9', 'volume_name': 'volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e09ccf-8a5b-4fce-84e3-5db4c3a1f4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e09ccf-8a5b-4fce-84e3-5db4c3a1f4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3525ec05-37f8-4680-965c-68607c411898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:01 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Volume 7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9', 'volume_size': 1} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1893658862',display_name='tempest-VolumesGetTest-Volume-1966772247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:01Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Creating volume 7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:01 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:01 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 1073741824 Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Acquiring lock "cinder-quobyte-95201407-92a9-4869-af14-2e2bb316ddb4" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:01 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Lock "cinder-quobyte-95201407-92a9-4869-af14-2e2bb316ddb4" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f572f38-c818-4a0b-a533-ce0780f8a4c7]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:01 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 Sep 08 13:55:01 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:01 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4" returned: 0 in 0.414s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:01 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4 Sep 08 13:55:01 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:01 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 1073741824" returned: 0 in 0.546s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:01 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 Sep 08 13:55:01 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Flow 'volume_create_manager' (8418c626-b86f-4f9d-9a68-fc750e67a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e360e1-b7fb-45b2-8537-364a2bcf821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e360e1-b7fb-45b2-8537-364a2bcf821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-976118064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd04d2e5-e210-465c-a996-a84ee19b2253,host='devstack@QuobyteHD#QuobyteHD',id=2889b9b9-4913-403b-b5f6-035d931b5dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec11dd5bd1d14b2ba8ccf86406b304a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:02Z,use_quota=True,user_id='7cbdefc66bba4301abb0e6c64df38e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a204d9e-f215-4008-8499-934be1591ee8),volume_type_id=9a204d9e-f215-4008-8499-934be1591ee8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50206ad-ec81-433e-b4e9-e8d7027e2c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:02 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50206ad-ec81-433e-b4e9-e8d7027e2c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bc285c-4385-455b-8044-807856cbb3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bc285c-4385-455b-8044-807856cbb3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2889b9b9-4913-403b-b5f6-035d931b5dc9', 'volume_name': 'volume-2889b9b9-4913-403b-b5f6-035d931b5dc9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974a83cb-5e9d-41d3-a06c-ec757383768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974a83cb-5e9d-41d3-a06c-ec757383768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3617fa5c-504f-4dde-908c-e1e90adf017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:02 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Volume 2889b9b9-4913-403b-b5f6-035d931b5dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2889b9b9-4913-403b-b5f6-035d931b5dc9', 'volume_size': 1} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-95201407-92a9-4869-af14-2e2bb316ddb4" returned: 0 in 0.441s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Lock "cinder-quobyte-95201407-92a9-4869-af14-2e2bb316ddb4" released by "delete_volume" :: held 0.913s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Created reservations ['95b7015c-cf18-48bb-b5c5-08e5255668d8', 'de6746c4-8f8f-475f-9aca-fc2909234231', '6e5ddf57-cfbc-43da-a753-7329225e4d7c', 'e569086d-2ff4-46ef-9573-33b6f8ee4ec7'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:02 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9" returned: 0 in 0.452s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd04d2e5-e210-465c-a996-a84ee19b2253,created_at=2026-09-08T11:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-976118064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd04d2e5-e210-465c-a996-a84ee19b2253,host='devstack@QuobyteHD#QuobyteHD',id=2889b9b9-4913-403b-b5f6-035d931b5dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec11dd5bd1d14b2ba8ccf86406b304a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:02Z,use_quota=True,user_id='7cbdefc66bba4301abb0e6c64df38e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a204d9e-f215-4008-8499-934be1591ee8),volume_type_id=9a204d9e-f215-4008-8499-934be1591ee8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Creating volume 2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:02 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3525ec05-37f8-4680-965c-68607c411898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:02 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 1073741824 Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d25ee2-11aa-47f3-b4ed-d898f2abaf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:02 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:02 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Volume volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 (7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9): created successfully Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d25ee2-11aa-47f3-b4ed-d898f2abaf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (c64fce0b-be39-40fb-85b6-4943b91f4e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:02 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ccada71f-e4b8-4868-93d9-698fbb6d4c3e tempest-VolumesGetTest-372354448 None] Created volume successfully. Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:02 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:02 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:02 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:02 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Deleted volume successfully. Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-911040d5-6511-4474-9077-da6ae13e0ce0 tempest-VolumesTransfersV355Test-1956888380 None] Lock "cinder-95201407-92a9-4869-af14-2e2bb316ddb4-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:02 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 1073741824" returned: 0 in 0.552s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:02 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 Sep 08 13:55:02 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:03 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:03 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:03 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9" returned: 0 in 0.321s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3617fa5c-504f-4dde-908c-e1e90adf017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2889b9b9-4913-403b-b5f6-035d931b5dc9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3409b872-c840-4398-827a-6075ef78507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:03 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Volume volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 (2889b9b9-4913-403b-b5f6-035d931b5dc9): created successfully Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3409b872-c840-4398-827a-6075ef78507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Flow 'volume_create_manager' (8418c626-b86f-4f9d-9a68-fc750e67a139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:03 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b6295bbb-416e-4528-ae8d-03c677789b4d tempest-GroupsV314Test-863888367 None] Created volume successfully. Sep 08 13:55:03 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.348s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Flow 'volume_create_manager' (41e1d337-e5eb-4dea-8344-18f4982b569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd1d0a6-75be-40e1-9a9c-3532ea8a3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd1d0a6-75be-40e1-9a9c-3532ea8a3313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2012409046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923394d80b174133aec2342e107ea0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:04Z,use_quota=True,user_id='15d2b3ea09ff4fe391c8907444d530ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1780bca-c85d-46b8-ba23-ef4acc28b9cb),volume_type_id=a1780bca-c85d-46b8-ba23-ef4acc28b9cb)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ce1e61-b247-4a1f-a80d-fcd28315174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ce1e61-b247-4a1f-a80d-fcd28315174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bceff68-4a63-4eb4-a194-c5042a43a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bceff68-4a63-4eb4-a194-c5042a43a255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085', 'volume_name': 'volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ea403b-15d3-4200-8786-5ab35aad433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ea403b-15d3-4200-8786-5ab35aad433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab2c229-9e9a-4976-80ec-75749214bfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:03 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume 3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085', 'volume_size': 1} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2012409046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923394d80b174133aec2342e107ea0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:04Z,use_quota=True,user_id='15d2b3ea09ff4fe391c8907444d530ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1780bca-c85d-46b8-ba23-ef4acc28b9cb),volume_type_id=a1780bca-c85d-46b8-ba23-ef4acc28b9cb)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Creating volume 3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:03 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Lock "cinder-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:03 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 1073741824 Sep 08 13:55:03 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ade9a3-945c-475a-bac4-c219ef4c4d8d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Flow 'volume_create_manager' (3115d471-76e8-45de-a763-c33c08856fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d6eee-d40a-412f-8ad6-71f46e61e50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:04 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 Sep 08 13:55:04 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d6eee-d40a-412f-8ad6-71f46e61e50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1290825942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56fe956-2503-4a7f-b2f0-bb8416c30283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923394d80b174133aec2342e107ea0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:04Z,use_quota=True,user_id='15d2b3ea09ff4fe391c8907444d530ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba9b9922-d5f7-43ed-a25f-3c02548bdc13),volume_type_id=ba9b9922-d5f7-43ed-a25f-3c02548bdc13)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c41d7e-96b8-42a9-a669-7ce420b683f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c41d7e-96b8-42a9-a669-7ce420b683f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc5b6b9-b0cd-400a-9e54-bc8799fb515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc5b6b9-b0cd-400a-9e54-bc8799fb515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56fe956-2503-4a7f-b2f0-bb8416c30283', 'volume_name': 'volume-d56fe956-2503-4a7f-b2f0-bb8416c30283', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196bba1a-7fc6-4935-ac45-7a5d8cc44219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196bba1a-7fc6-4935-ac45-7a5d8cc44219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f57c1f0-c9f3-461f-8d91-a05ee47db5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:04 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume d56fe956-2503-4a7f-b2f0-bb8416c30283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56fe956-2503-4a7f-b2f0-bb8416c30283', 'volume_size': 1} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:04 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 1073741824" returned: 0 in 0.561s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:04 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 Sep 08 13:55:04 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:04 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9" returned: 0 in 0.602s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:04 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9 Sep 08 13:55:04 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:04 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085" returned: 0 in 0.370s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1290825942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56fe956-2503-4a7f-b2f0-bb8416c30283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923394d80b174133aec2342e107ea0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:04Z,use_quota=True,user_id='15d2b3ea09ff4fe391c8907444d530ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba9b9922-d5f7-43ed-a25f-3c02548bdc13),volume_type_id=ba9b9922-d5f7-43ed-a25f-3c02548bdc13)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Creating volume d56fe956-2503-4a7f-b2f0-bb8416c30283 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:04 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab2c229-9e9a-4976-80ec-75749214bfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:04 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 1073741824 Sep 08 13:55:04 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0fa345-32d5-4e50-89e6-dad6c2de8e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:04 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 (3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085): created successfully Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0fa345-32d5-4e50-89e6-dad6c2de8e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Flow 'volume_create_manager' (41e1d337-e5eb-4dea-8344-18f4982b569f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:04 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-010576cc-e369-42f4-94c2-6f96c8b43e63 tempest-TestInstancesWithCinderVolumes-50787398 None] Created volume successfully. Sep 08 13:55:04 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9" returned: 0 in 0.441s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9" released by "delete_volume" :: held 1.098s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Created reservations ['d7d18977-88f9-4c42-91ec-8cd472e12b66', '409e1cba-0603-4959-bd15-9e627548ee14', '9f900941-b338-4607-9982-6039e7c6405a', 'a089e701-89e5-4cca-8dc2-06b781bf662b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:05 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:05 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:05 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:05 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.377s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 1073741824" returned: 0 in 0.752s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Lock "cinder-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Deleted volume successfully. Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Flow 'volume_create_manager' (9a258d25-7952-41db-8265-63dc3220157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dd9a7d-1566-4280-b5d3-c029aaf15dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dd9a7d-1566-4280-b5d3-c029aaf15dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1770286422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d34efb8-536e-4c8b-a6e7-57467e4cae39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923394d80b174133aec2342e107ea0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:05Z,use_quota=True,user_id='15d2b3ea09ff4fe391c8907444d530ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f59e63f3-1ad2-4113-abc5-ed585f87b683),volume_type_id=f59e63f3-1ad2-4113-abc5-ed585f87b683)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee6f9b0-5a73-4ba3-bb7d-c15da5a4fdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee6f9b0-5a73-4ba3-bb7d-c15da5a4fdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c14bbd2-2a8a-406d-8041-f87224c6f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:05 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 Sep 08 13:55:05 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3d726c1d-39ee-4083-a75f-52639f9c94ad tempest-VolumesGetTest-372354448 None] Lock "cinder-7f3dcb2b-2bcf-4b88-9755-d48464d3d4a9-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2" acquired by "delete_volume" :: waited 0.054s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:05 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=190,cinder:INSERT=57,cinder:UPDATE=214,cinder:DELETE=13 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f3d186-5bc5-443e-9d56-eb0c93bf4222]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=175,cinder:UPDATE=223,cinder:DELETE=13,cinder:INSERT=50 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:06 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 Sep 08 13:55:06 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:06 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.182s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:06 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Cloning volume 2889b9b9-4913-403b-b5f6-035d931b5dc9 to volume 669b9e83-39f5-4fd1-820d-e0f8b3cb3141 Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f57c1f0-c9f3-461f-8d91-a05ee47db5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56fe956-2503-4a7f-b2f0-bb8416c30283', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a75adf-4bb7-4971-9e76-64d0b0ac11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:06 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 (d56fe956-2503-4a7f-b2f0-bb8416c30283): created successfully Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a75adf-4bb7-4971-9e76-64d0b0ac11fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Flow 'volume_create_manager' (3115d471-76e8-45de-a763-c33c08856fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Creating offline snapshot 04eb8a5d-f3d1-4905-b769-11d814865fee of volume 2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:55:06 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f9e65e81-bf31-4403-bb8f-57cb09ac0228 tempest-TestInstancesWithCinderVolumes-50787398 None] Created volume successfully. Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3564f5-a1ac-41a6-b684-7ffdd819d547]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c14bbd2-2a8a-406d-8041-f87224c6f901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d34efb8-536e-4c8b-a6e7-57467e4cae39', 'volume_name': 'volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39', 'volume_size': 1, 'image_id': 'e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--665447929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '923394d80b174133aec2342e107ea0fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'created_at': datetime.datetime(2026, 9, 8, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 55, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766/file', 'properties': {}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f382f49c-40de-460a-8714-8978e32b1b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f382f49c-40de-460a-8714-8978e32b1b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9a9b96-e086-41b3-9a73-796b7ff1dfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:06 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume 4d34efb8-536e-4c8b-a6e7-57467e4cae39: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39', 'volume_size': 1, 'image_id': 'e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--665447929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '923394d80b174133aec2342e107ea0fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'created_at': datetime.datetime(2026, 9, 8, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 55, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766/file', 'properties': {}}, 'image_service': } Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Trying to clone 4d34efb8-536e-4c8b-a6e7-57467e4cae39 from image e87d95ab-a7fa-4ffc-a19c-91865f0ff766 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 13:55:06 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 Sep 08 13:55:06 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:06 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2" returned: 0 in 0.566s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:06 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2 Sep 08 13:55:06 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:06 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9" returned: 0 in 0.469s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:06 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:06 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee 1G Sep 08 13:55:06 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2" released by "delete_volume" :: held 0.921s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:06 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Created reservations ['422580a2-d0b3-4217-a2b4-07aaac09beaa', '439def45-2887-4734-8e6a-cd5e4b96f345', 'd43767bd-41fe-415a-94b5-29c25bd0bdff', 'fddbac2d-eb09-4df8-892c-6c97c7c55244'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:07 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:07 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:07 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.388s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:07 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Deleted volume successfully. Sep 08 13:55:07 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee 1G" returned: 0 in 0.598s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8b2f6833-e449-4e33-8939-b0efd8e32f3b tempest-VolumesGetTest-372354448 None] Lock "cinder-d377ef28-c252-4f5e-8fa6-86f7a7e98ca2-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:07 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee Sep 08 13:55:07 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:07 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee" returned: 0 in 0.401s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:07 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:55:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:07 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee Sep 08 13:55:07 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:08 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee" returned: 0 in 0.315s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:08 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.info Sep 08 13:55:08 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (bf48d98d-dd24-429b-97c3-2b3987052e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be87cf57-dced-4feb-a7bf-8745f08f6b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be87cf57-dced-4feb-a7bf-8745f08f6b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-786609856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4877b5e6-7f31-4466-a977-eb6ddc35a63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:08Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9ac5a1-3d15-429c-aa19-b082e2e7d272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9ac5a1-3d15-429c-aa19-b082e2e7d272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bfecbf-cf92-486e-bbfa-8599b4c68b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bfecbf-cf92-486e-bbfa-8599b4c68b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4877b5e6-7f31-4466-a977-eb6ddc35a63e', 'volume_name': 'volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028c3415-1b9c-4d36-9550-8ca95421ca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028c3415-1b9c-4d36-9550-8ca95421ca11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b71210d-28be-4599-a849-47112e2e50e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:08 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Volume 4877b5e6-7f31-4466-a977-eb6ddc35a63e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e', 'volume_size': 1} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:08 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.info" returned: 0 in 0.444s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:08 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:08 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.info Sep 08 13:55:08 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:08 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.info" returned: 0 in 0.252s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Acquiring lock "cinder-quobyte-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Lock "cinder-quobyte-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] snapshot: 04eb8a5d-f3d1-4905-b769-11d814865fee, volume: 669b9e83-39f5-4fd1-820d-e0f8b3cb3141, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f0e508-fe2a-48fe-abfb-8606311e9fda]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:09 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee Sep 08 13:55:09 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:09 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee" returned: 0 in 0.417s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2889b9b9-4913-403b-b5f6-035d931b5dc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[df82aad1-999e-4b05-bb0f-c74d607f422c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:09 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 Sep 08 13:55:09 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:09 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9" returned: 0 in 0.466s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 13:55:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:09 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 Sep 08 13:55:09 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:11 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD, size 20.69 MB, duration 5.14 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 13:55:11 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Image download 20.69 MB at 4.02 MB/s Sep 08 13:55:11 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[78210140-2894-48c5-9493-2604aa6edcb1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:12 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD Sep 08 13:55:12 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:12 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:12 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Temporary image e87d95ab-a7fa-4ffc-a19c-91865f0ff766 is fetched for user 15d2b3ea09ff4fe391c8907444d530ee. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 13:55:12 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3434df1-ec8b-4800-904e-d8e0157b5d4c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:12 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD Sep 08 13:55:12 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:13 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD" returned: 0 in 0.646s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:15 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" returned: 0 in 5.199s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:55:15 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Converted 1024.00 MB image at 196.94 MB/s Sep 08 13:55:15 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:15 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 Sep 08 13:55:15 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:15 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" returned: 0 in 0.249s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Lock "cinder-quobyte-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" released by "_copy_volume_from_snapshot" :: held 6.428s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Acquiring lock "cinder-quobyte-04eb8a5d-f3d1-4905-b769-11d814865fee" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Lock "cinder-quobyte-04eb8a5d-f3d1-4905-b769-11d814865fee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Deleting offline snapshot 04eb8a5d-f3d1-4905-b769-11d814865fee of volume 2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] snapshot_file for this snap is: volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50847c6-bbc8-41df-adf4-e501f9d70c60]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:15 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee Sep 08 13:55:15 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:15 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee" returned: 0 in 0.372s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2889b9b9-4913-403b-b5f6-035d931b5dc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7424a4c8-07cc-4cd8-911a-3d8ba0ca8ece]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:15 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 Sep 08 13:55:15 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:16 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9" returned: 0 in 0.526s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:16 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee Sep 08 13:55:16 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:16 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee" returned: 0 in 0.346s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:16 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee Sep 08 13:55:16 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:16 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9.04eb8a5d-f3d1-4905-b769-11d814865fee" returned: 0 in 0.244s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Lock "cinder-quobyte-04eb8a5d-f3d1-4905-b769-11d814865fee" released by "_delete_snapshot" :: held 1.594s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.782s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.380s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-786609856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4877b5e6-7f31-4466-a977-eb6ddc35a63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:08Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Creating volume 4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:17 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:17 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e 1073741824 Sep 08 13:55:17 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-368da398-959c-4eaa-b520-4d423d46c171 tempest-GroupsV314Test-863888367 None] Create group from source-group-bd04d2e5-e210-465c-a996-a84ee19b2253 completed successfully. Sep 08 13:55:17 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e 1073741824" returned: 0 in 0.446s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:17 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e Sep 08 13:55:17 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:17 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e" returned: 0 in 0.251s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.467s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1770286422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d34efb8-536e-4c8b-a6e7-57467e4cae39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923394d80b174133aec2342e107ea0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:05Z,use_quota=True,user_id='15d2b3ea09ff4fe391c8907444d530ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f59e63f3-1ad2-4113-abc5-ed585f87b683),volume_type_id=f59e63f3-1ad2-4113-abc5-ed585f87b683)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Creating volume 4d34efb8-536e-4c8b-a6e7-57467e4cae39 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:17 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:17 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 1073741824 Sep 08 13:55:17 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b71210d-28be-4599-a849-47112e2e50e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f8b258-f754-4895-b099-c4bed0ce34d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:17 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Volume volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e (4877b5e6-7f31-4466-a977-eb6ddc35a63e): created successfully Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f8b258-f754-4895-b099-c4bed0ce34d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (bf48d98d-dd24-429b-97c3-2b3987052e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f2ef9f6b-5f66-4d1e-a97e-eeec9f5bd61e tempest-VolumesGetTest-372354448 None] Created volume successfully. Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Acquiring lock "cinder-quobyte-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Lock "cinder-quobyte-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[35df6fd9-3314-4a4e-9014-54638e5c9db6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:18 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 Sep 08 13:55:18 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:18 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 1073741824" returned: 0 in 0.663s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:18 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 Sep 08 13:55:18 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:18 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" returned: 0 in 0.496s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:18 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141 Sep 08 13:55:18 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:18 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39" returned: 0 in 0.319s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Attempting download of e87d95ab-a7fa-4ffc-a19c-91865f0ff766 ((None, [{'url': 'file:///opt/stack/data/glance/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'metadata': {}}])) to volume 4d34efb8-536e-4c8b-a6e7-57467e4cae39. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6537b2bc-1c1f-4e83-b570-3d6c0ac7da15]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_gaij1p1e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:19 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" returned: 0 in 0.320s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Lock "cinder-quobyte-669b9e83-39f5-4fd1-820d-e0f8b3cb3141" released by "delete_volume" :: held 0.864s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:19 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_gaij1p1e Sep 08 13:55:19 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (c1cfc78e-c94d-481f-807a-b1f4f626b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb5655d-b5be-4767-bb39-aa4b34509a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb5655d-b5be-4767-bb39-aa4b34509a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1113534283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1ccbca-9002-4126-95a6-234c93c99837,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4877b5e6-7f31-4466-a977-eb6ddc35a63e,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:19Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69b46e2-5862-44f2-aa00-a1e2cbbbbb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69b46e2-5862-44f2-aa00-a1e2cbbbbb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7da269a-4cbb-4eef-85c0-4bdab87e5c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Created reservations ['b26522da-3def-436e-a927-6969bb149688'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7da269a-4cbb-4eef-85c0-4bdab87e5c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4d1ccbca-9002-4126-95a6-234c93c99837', 'volume_name': 'volume-4d1ccbca-9002-4126-95a6-234c93c99837', 'volume_size': 1, 'source_volid': '4877b5e6-7f31-4466-a977-eb6ddc35a63e', 'source_volstatus': 'available'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101b5b31-38d9-4009-ab70-92da369df645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101b5b31-38d9-4009-ab70-92da369df645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c9884f-0c7b-42c7-999d-e013754cdb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Volume 4d1ccbca-9002-4126-95a6-234c93c99837: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4d1ccbca-9002-4126-95a6-234c93c99837', 'volume_size': 1, 'source_volid': '4877b5e6-7f31-4466-a977-eb6ddc35a63e', 'source_volstatus': 'available'} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:19 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Cloning volume 4877b5e6-7f31-4466-a977-eb6ddc35a63e to volume 4d1ccbca-9002-4126-95a6-234c93c99837 Sep 08 13:55:19 devstack cinder-volume[87262]: WARNING cinder.quota [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-12644115 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-12644115, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:55:19 devstack cinder-volume[87262]: WARNING cinder.quota [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-12644115 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-12644115, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Creating offline snapshot f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 of volume 4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Created reservations ['b6f219f2-77ac-4772-a14e-d269c2d7c02e', '38089704-2260-421e-a6c6-078c5e155ea7', '543d4496-4c0b-42d1-b969-4a61ba550144', '70fc8399-a0f9-43ed-8215-cfccca7fce1f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59dd461-2d66-4134-98f4-880a9fd46016]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:19 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_gaij1p1e" returned: 0 in 0.399s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_gaij1p1e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:19 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e Sep 08 13:55:19 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:19 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_gaij1p1e Sep 08 13:55:19 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:19 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:19 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:19 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_gaij1p1e" returned: 1 in 0.442s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_gaij1p1e' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23b9a4e-1bf8-4d9b-a56a-3bd1fa75b762]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:19 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:19 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e" returned: 0 in 0.501s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.314s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:19 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-722e9710-b385-4fc7-8925-90473e3d0f9b tempest-GroupsV314Test-863888367 None] Delete group completed successfully. Sep 08 13:55:19 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 1G Sep 08 13:55:19 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:19 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD Sep 08 13:55:19 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:20 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] e87d95ab-a7fa-4ffc-a19c-91865f0ff766 was qcow2, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:20 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 Sep 08 13:55:20 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:20 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 1G" returned: 0 in 0.436s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:20 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 Sep 08 13:55:20 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:20 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" returned: 0 in 0.352s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:20 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 is being set with open permissions: ugo+rw Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:20 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 Sep 08 13:55:20 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Acquiring lock "cinder-quobyte-2889b9b9-4913-403b-b5f6-035d931b5dc9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Lock "cinder-quobyte-2889b9b9-4913-403b-b5f6-035d931b5dc9" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:20 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" returned: 0 in 0.361s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[801f2cd9-75c5-4085-b2b3-58109a3e47b7]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:21 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.info Sep 08 13:55:21 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:21 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 Sep 08 13:55:21 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:21 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.info" returned: 0 in 0.335s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:21 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.info is being set with open permissions: ugo+rw Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:21 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.info Sep 08 13:55:21 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:21 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9" returned: 0 in 0.546s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:21 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9 Sep 08 13:55:21 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:21 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.info" returned: 0 in 0.273s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-4d1ccbca-9002-4126-95a6-234c93c99837" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-4d1ccbca-9002-4126-95a6-234c93c99837" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] snapshot: f14cbffb-6f91-43c7-8cec-42cb4d6c75b8, volume: 4d1ccbca-9002-4126-95a6-234c93c99837, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c127cc-1608-4347-8a92-863f6e009106]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:21 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2889b9b9-4913-403b-b5f6-035d931b5dc9" returned: 0 in 0.288s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Lock "cinder-quobyte-2889b9b9-4913-403b-b5f6-035d931b5dc9" released by "delete_volume" :: held 0.909s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:21 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 Sep 08 13:55:21 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:21 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Created reservations ['219bd8f7-e6c9-43c8-b6c8-f04b6ae80cf3'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Created reservations ['b3e55b23-c96f-4424-a7ee-9fd773641e5f', '01e55006-1672-466b-9962-d87b2ce605f5', '580e98db-d079-45fc-ac9d-fe5961c13cde', 'df3ac3b1-cec4-411e-8971-106b8e5bd423'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:22 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" returned: 0 in 0.516s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:55:22 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:22 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3641f8a-1490-488a-afaa-05f010057c28]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:22 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39" returned: 0 in 2.242s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e87d95ab-a7fa-4ffc-a19c-91865f0ff766_ebfr7yf7devstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:55:22 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Converted 112.00 MB image at 49.93 MB/s Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:22 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 1G Sep 08 13:55:22 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:22 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e Sep 08 13:55:22 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:22 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.283s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0da65284-6c05-4255-90f6-af29cdce434b tempest-GroupsV314Test-863888367 None] Delete group completed successfully. Sep 08 13:55:22 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e" returned: 0 in 0.404s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:22 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 1G" returned: 0 in 0.357s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Downloaded image e87d95ab-a7fa-4ffc-a19c-91865f0ff766 ((None, [{'url': 'file:///opt/stack/data/glance/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'metadata': {}}])) to volume 4d34efb8-536e-4c8b-a6e7-57467e4cae39 successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 13:55:22 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 Sep 08 13:55:22 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Temporary image e87d95ab-a7fa-4ffc-a19c-91865f0ff766 for user 15d2b3ea09ff4fe391c8907444d530ee is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Marking volume 4d34efb8-536e-4c8b-a6e7-57467e4cae39 as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Copying metadata from image e87d95ab-a7fa-4ffc-a19c-91865f0ff766 to 4d34efb8-536e-4c8b-a6e7-57467e4cae39. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Creating volume glance metadata for volume 4d34efb8-536e-4c8b-a6e7-57467e4cae39 backed by image e87d95ab-a7fa-4ffc-a19c-91865f0ff766 with: {'image_id': 'e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'image_name': 'tempest-scenario-img--665447929', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9a9b96-e086-41b3-9a73-796b7ff1dfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39', 'volume_size': 1, 'image_id': 'e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--665447929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '923394d80b174133aec2342e107ea0fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e87d95ab-a7fa-4ffc-a19c-91865f0ff766', 'created_at': datetime.datetime(2026, 9, 8, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 55, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e87d95ab-a7fa-4ffc-a19c-91865f0ff766/file', 'properties': {}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a46bbc3-3d9c-4465-86e6-04e681f59491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:22 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Volume volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 (4d34efb8-536e-4c8b-a6e7-57467e4cae39): created successfully Sep 08 13:55:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a46bbc3-3d9c-4465-86e6-04e681f59491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Flow 'volume_create_manager' (9a258d25-7952-41db-8265-63dc3220157d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1324817f-a153-47c5-aaba-d27e23d54b75 tempest-TestInstancesWithCinderVolumes-50787398 None] Created volume successfully. Sep 08 13:55:29 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837" returned: 0 in 6.889s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:29 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:55:29 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Converted 1024.00 MB image at 148.63 MB/s Sep 08 13:55:29 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 is being set with open permissions: ugo+rw Sep 08 13:55:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:29 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 Sep 08 13:55:29 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:30 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837" returned: 0 in 0.392s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-4d1ccbca-9002-4126-95a6-234c93c99837" released by "_copy_volume_from_snapshot" :: held 8.311s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Deleting offline snapshot f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 of volume 4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] snapshot_file for this snap is: volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e20dc9d-9cb5-4c08-acea-796bc1daaaae]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:30 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 Sep 08 13:55:30 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:30 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" returned: 0 in 0.534s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[69803be9-8101-4b4e-a651-16a94ce80471]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-e19dcda9-5af1-4b8e-9545-3212fd2ed127 req-42c6a36d-7d1e-49f0-912a-82acf2ab1310 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:30 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e Sep 08 13:55:30 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:31 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e" returned: 0 in 0.637s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:31 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 Sep 08 13:55:31 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:31 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" returned: 0 in 0.538s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:31 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8 Sep 08 13:55:31 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:32 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e.f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" returned: 0 in 0.314s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-f14cbffb-6f91-43c7-8cec-42cb4d6c75b8" released by "_delete_snapshot" :: held 2.190s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.122s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-e19dcda9-5af1-4b8e-9545-3212fd2ed127 req-42c6a36d-7d1e-49f0-912a-82acf2ab1310 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.646s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-e19dcda9-5af1-4b8e-9545-3212fd2ed127 req-42c6a36d-7d1e-49f0-912a-82acf2ab1310 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c9884f-0c7b-42c7-999d-e013754cdb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1ccbca-9002-4126-95a6-234c93c99837', 'volume_size': 1, 'source_volid': '4877b5e6-7f31-4466-a977-eb6ddc35a63e', 'source_volstatus': 'available'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868b53e4-de12-47d5-8fe3-081a98714088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:32 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Volume volume-4d1ccbca-9002-4126-95a6-234c93c99837 (4d1ccbca-9002-4126-95a6-234c93c99837): created successfully Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868b53e4-de12-47d5-8fe3-081a98714088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (c1cfc78e-c94d-481f-807a-b1f4f626b793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-e19dcda9-5af1-4b8e-9545-3212fd2ed127 req-42c6a36d-7d1e-49f0-912a-82acf2ab1310 tempest-TestInstancesWithCinderVolumes-50787398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bb285cf-b843-4498-af7c-813888108c04', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:55:32 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-49babb90-6a9b-4417-a922-e6c266bea518 tempest-VolumesGetTest-372354448 None] Created volume successfully. Sep 08 13:55:32 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-e19dcda9-5af1-4b8e-9545-3212fd2ed127 req-42c6a36d-7d1e-49f0-912a-82acf2ab1310 tempest-TestInstancesWithCinderVolumes-50787398 None] attachment_update completed successfully. Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (b8c3a695-e5d5-42d4-a086-999c3dfe48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af2b805-254a-47e6-839a-99fdeaee5bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af2b805-254a-47e6-839a-99fdeaee5bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-223590342',display_name='tempest-VolumesGetTest-Volume-1200126148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8085ecfa-60c9-47c2-bb92-e7d3882d26a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:34Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c6912d-d893-4656-80eb-c2f4e1a4a105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c6912d-d893-4656-80eb-c2f4e1a4a105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f837a689-f116-4fd6-a004-e0bf8a3f89a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f837a689-f116-4fd6-a004-e0bf8a3f89a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8085ecfa-60c9-47c2-bb92-e7d3882d26a0', 'volume_name': 'volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e53be6a-e615-4e33-a6ba-bb3328393431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e53be6a-e615-4e33-a6ba-bb3328393431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19602e65-8247-4fa8-bc9e-c6dfe18deec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:34 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Volume 8085ecfa-60c9-47c2-bb92-e7d3882d26a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0', 'volume_size': 1} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-223590342',display_name='tempest-VolumesGetTest-Volume-1200126148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8085ecfa-60c9-47c2-bb92-e7d3882d26a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:34Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Creating volume 8085ecfa-60c9-47c2-bb92-e7d3882d26a0 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:34 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:34 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 1073741824 Sep 08 13:55:34 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:34 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 1073741824" returned: 0 in 0.679s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:34 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 Sep 08 13:55:34 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:35 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0" returned: 0 in 0.363s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19602e65-8247-4fa8-bc9e-c6dfe18deec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74a4d2e-da89-43a3-8380-57500cd73102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:35 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Volume volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 (8085ecfa-60c9-47c2-bb92-e7d3882d26a0): created successfully Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74a4d2e-da89-43a3-8380-57500cd73102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (b8c3a695-e5d5-42d4-a086-999c3dfe48a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:35 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b247c4d7-1d3b-4dc4-8b79-904851ff96f8 tempest-VolumesGetTest-372354448 None] Created volume successfully. Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (10aa0535-811e-4714-b0ec-bb671f29fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f197e4-77a5-4857-970a-916047548ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f197e4-77a5-4857-970a-916047548ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1584806324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b350d38a-e6d8-489b-9788-97dc5c9c432f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3387be31140949ff984f6b075e0020c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:35Z,use_quota=True,user_id='ff7b968bef484f569b4a70f8570b0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1204392f-749b-4ea7-8933-60d0c8863ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1204392f-749b-4ea7-8933-60d0c8863ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d43b645-5590-4399-874c-28f17f48ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d43b645-5590-4399-874c-28f17f48ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b350d38a-e6d8-489b-9788-97dc5c9c432f', 'volume_name': 'volume-b350d38a-e6d8-489b-9788-97dc5c9c432f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22c933b-1f07-471f-b98c-0da9f1e46e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22c933b-1f07-471f-b98c-0da9f1e46e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c667ec3e-5281-403c-8e4e-c6119421e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:35 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Volume b350d38a-e6d8-489b-9788-97dc5c9c432f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b350d38a-e6d8-489b-9788-97dc5c9c432f', 'volume_size': 1} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1584806324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b350d38a-e6d8-489b-9788-97dc5c9c432f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3387be31140949ff984f6b075e0020c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:35Z,use_quota=True,user_id='ff7b968bef484f569b4a70f8570b0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Creating volume b350d38a-e6d8-489b-9788-97dc5c9c432f {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:35 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:35 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f 1073741824 Sep 08 13:55:35 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:36 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f 1073741824" returned: 0 in 0.600s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:36 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f Sep 08 13:55:36 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-8085ecfa-60c9-47c2-bb92-e7d3882d26a0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Lock "cinder-8085ecfa-60c9-47c2-bb92-e7d3882d26a0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-8085ecfa-60c9-47c2-bb92-e7d3882d26a0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-8085ecfa-60c9-47c2-bb92-e7d3882d26a0" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:36 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f" returned: 0 in 0.396s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de6f51e-d33d-4670-8020-559cd9d4837b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c667ec3e-5281-403c-8e4e-c6119421e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b350d38a-e6d8-489b-9788-97dc5c9c432f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b768cfb5-4ee1-4470-9179-d13db072d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:36 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Volume volume-b350d38a-e6d8-489b-9788-97dc5c9c432f (b350d38a-e6d8-489b-9788-97dc5c9c432f): created successfully Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b768cfb5-4ee1-4470-9179-d13db072d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (10aa0535-811e-4714-b0ec-bb671f29fab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4e5e67d3-a05c-4f87-be20-6b82ef0375ce tempest-VolumesSnapshotTestJSON-592573456 None] Created volume successfully. Sep 08 13:55:36 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 Sep 08 13:55:36 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:37 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0" returned: 0 in 0.823s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:37 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0 Sep 08 13:55:37 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:38 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8085ecfa-60c9-47c2-bb92-e7d3882d26a0" returned: 0 in 0.496s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-8085ecfa-60c9-47c2-bb92-e7d3882d26a0" released by "delete_volume" :: held 1.410s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Created reservations ['30375c94-9722-44d4-bc64-79d691c0f872', '68db7515-af28-413a-b372-03f01e13642a', '4fada93a-7c03-4b12-9f17-40594fbd4850', '4484a39b-fed7-4797-bab4-2c801b6489ef'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:38 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:38 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:38 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.448s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Deleted volume successfully. Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Creating offline snapshot fac46330-5735-45ba-aa55-0644155701a8 of volume b350d38a-e6d8-489b-9788-97dc5c9c432f {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6e1fc11c-1b29-4ddd-b526-d457c01cdf09 tempest-VolumesGetTest-372354448 None] Lock "cinder-8085ecfa-60c9-47c2-bb92-e7d3882d26a0-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[733575f4-01ce-4424-a155-41188c8d8840]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-4d1ccbca-9002-4126-95a6-234c93c99837-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Lock "cinder-4d1ccbca-9002-4126-95a6-234c93c99837-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-4d1ccbca-9002-4126-95a6-234c93c99837" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-4d1ccbca-9002-4126-95a6-234c93c99837" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:39 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f Sep 08 13:55:39 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b140a5a9-08b3-4dbf-88e2-ab4b26180809]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:39 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 Sep 08 13:55:39 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:39 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f" returned: 0 in 0.811s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:39 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 1G Sep 08 13:55:39 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:39 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837" returned: 0 in 0.661s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:40 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837 Sep 08 13:55:40 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:40 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d1ccbca-9002-4126-95a6-234c93c99837" returned: 0 in 0.381s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:40 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 1G" returned: 0 in 0.596s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b350d38a-e6d8-489b-9788-97dc5c9c432f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-4d1ccbca-9002-4126-95a6-234c93c99837" released by "delete_volume" :: held 1.274s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:40 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b350d38a-e6d8-489b-9788-97dc5c9c432f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 Sep 08 13:55:40 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Created reservations ['44e41ce0-542b-433c-86f0-ef511d167df9', '3099fb27-cce2-4a67-83b0-d19d7ce8b010', 'a0a5cb6c-fbcf-4676-b0e4-3de8c869a46e', 'a5818ed5-03b1-42ea-9268-2e01b6ef714a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:40 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:40 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:40 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b350d38a-e6d8-489b-9788-97dc5c9c432f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8" returned: 0 in 0.571s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:40 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 is being set with open permissions: ugo+rw Sep 08 13:55:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:40 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 Sep 08 13:55:40 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:41 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.411s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Deleted volume successfully. Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e50b21dd-fad3-40d8-b604-95398187520c tempest-VolumesGetTest-372354448 None] Lock "cinder-4d1ccbca-9002-4126-95a6-234c93c99837-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:41 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8" returned: 0 in 0.420s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:41 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.info Sep 08 13:55:41 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-4877b5e6-7f31-4466-a977-eb6ddc35a63e-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Lock "cinder-4877b5e6-7f31-4466-a977-eb6ddc35a63e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-4877b5e6-7f31-4466-a977-eb6ddc35a63e" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-4877b5e6-7f31-4466-a977-eb6ddc35a63e" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c9e158-1bec-4f42-b632-a676200eb273]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:41 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.info" returned: 0 in 0.559s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:41 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.info is being set with open permissions: ugo+rw Sep 08 13:55:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:42 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.info Sep 08 13:55:42 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:42 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e Sep 08 13:55:42 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:42 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.info" returned: 0 in 0.537s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.683s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:42 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e" returned: 0 in 0.764s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:42 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e Sep 08 13:55:42 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5595a454-674e-4e81-835e-8f7f5f1bb515 tempest-VolumesSnapshotTestJSON-592573456 None] Create snapshot completed successfully Sep 08 13:55:42 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4877b5e6-7f31-4466-a977-eb6ddc35a63e" returned: 0 in 0.375s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-4877b5e6-7f31-4466-a977-eb6ddc35a63e" released by "delete_volume" :: held 1.244s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Created reservations ['b61448d8-a6ba-4630-9bb6-abaa2e9e1db5', '7bebb16f-0450-45d6-ad67-063a4473cfe3', '313951f9-d0a0-49a9-b3d6-47dcb4f14d0f', '0e09be3a-59ab-41d2-b4fb-70af27d42cec'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:43 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:55:43 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-fac46330-5735-45ba-aa55-0644155701a8-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-fac46330-5735-45ba-aa55-0644155701a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-b350d38a-e6d8-489b-9788-97dc5c9c432f" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-b350d38a-e6d8-489b-9788-97dc5c9c432f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-fac46330-5735-45ba-aa55-0644155701a8" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-fac46330-5735-45ba-aa55-0644155701a8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Deleting offline snapshot fac46330-5735-45ba-aa55-0644155701a8 of volume b350d38a-e6d8-489b-9788-97dc5c9c432f {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] snapshot_file for this snap is: volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:55:43 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.533s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:55:43 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Deleted volume successfully. Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2441c4e-403e-42be-b558-b21e35a90b71]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5c089620-db84-4eb8-a594-c33240e5fbcd tempest-VolumesGetTest-372354448 None] Lock "cinder-4877b5e6-7f31-4466-a977-eb6ddc35a63e-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:43 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 Sep 08 13:55:43 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:44 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8" returned: 0 in 0.623s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b350d38a-e6d8-489b-9788-97dc5c9c432f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:55:44 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7034eedd-df11-40aa-bbd8-129ab2a4551e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:44 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f Sep 08 13:55:44 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:45 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f" returned: 0 in 0.605s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:45 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 Sep 08 13:55:45 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (9d3a48b3-3e08-49d8-af57-ea5457c41be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05181f66-50ef-4059-aab0-eaa72cdf8448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05181f66-50ef-4059-aab0-eaa72cdf8448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1550150004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b129a0ea-8bc9-44c8-83a5-a27af8e4fab5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:46Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2f02b2-9868-4b22-9e6e-b7ce3c2a2469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2f02b2-9868-4b22-9e6e-b7ce3c2a2469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1737b5-9877-410b-b890-8c54483669d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:45 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8" returned: 0 in 1.001s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:46 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:46 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8 Sep 08 13:55:46 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1737b5-9877-410b-b890-8c54483669d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b129a0ea-8bc9-44c8-83a5-a27af8e4fab5', 'volume_name': 'volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe5214b-265a-456a-8676-83fa7a586260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe5214b-265a-456a-8676-83fa7a586260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa77e264-3031-4987-9ae3-02c32b43f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:46 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Volume b129a0ea-8bc9-44c8-83a5-a27af8e4fab5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Trying to clone b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f at location (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 13:55:46 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f.fac46330-5735-45ba-aa55-0644155701a8" returned: 0 in 0.604s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-fac46330-5735-45ba-aa55-0644155701a8" released by "_delete_snapshot" :: held 3.154s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-b350d38a-e6d8-489b-9788-97dc5c9c432f" released by "delete_snapshot" :: held 3.217s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:47 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Created reservations ['294aa1a7-423b-40be-9b14-033b586516e8', '550d24a3-03f0-4722-af96-b7dfbbc6310b', 'd12c47d4-6c99-4228-822b-7a2d97a76bb1', '1e6e24b2-3485-43ae-8e2a-36b13f0886e9'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:55:47 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 13:55:47 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Image download 20.69 MB at 20.69 MB/s Sep 08 13:55:47 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Delete snapshot completed successfully. Sep 08 13:55:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e99136c9-e5b3-4034-b9d3-c3dd922ea3df tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-fac46330-5735-45ba-aa55-0644155701a8-delete_snapshot" released by "delete_snapshot" :: held 3.849s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:55:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7001df01-5bfb-4174-a051-cb59ebac34f4]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:47 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD Sep 08 13:55:47 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:47 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:47 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f is fetched for user 0ba465bd020a41c18177579d38768c58. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f491b51-0bad-4337-a3b4-a748d611da51]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:48 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD Sep 08 13:55:48 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:48 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD" returned: 0 in 0.601s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1550150004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b129a0ea-8bc9-44c8-83a5-a27af8e4fab5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:46Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Creating volume b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:48 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:48 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 1073741824 Sep 08 13:55:48 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (c8773d53-0551-4a7e-9269-ebd6af63f13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4cf76e-8cf0-4727-a81c-738402170b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4cf76e-8cf0-4727-a81c-738402170b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2104793804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be17c7fb-b753-482f-9867-bd1cd71f6ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3387be31140949ff984f6b075e0020c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:49Z,use_quota=True,user_id='ff7b968bef484f569b4a70f8570b0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0104faac-4529-4607-a1a4-2fb2582cf21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0104faac-4529-4607-a1a4-2fb2582cf21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c0c788-d581-49ce-85ca-4b84bd337603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c0c788-d581-49ce-85ca-4b84bd337603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be17c7fb-b753-482f-9867-bd1cd71f6ab5', 'volume_name': 'volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757a2ee3-f29c-4cab-859c-48efe0c072ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757a2ee3-f29c-4cab-859c-48efe0c072ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4701fc7c-6103-4cd6-90a6-d73db30b34d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:49 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Volume be17c7fb-b753-482f-9867-bd1cd71f6ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5', 'volume_size': 1} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:49 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 1073741824" returned: 0 in 0.792s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:49 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 Sep 08 13:55:49 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:49 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5" returned: 0 in 0.316s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2104793804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be17c7fb-b753-482f-9867-bd1cd71f6ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3387be31140949ff984f6b075e0020c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:49Z,use_quota=True,user_id='ff7b968bef484f569b4a70f8570b0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Creating volume be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:49 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:49 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 1073741824 Sep 08 13:55:49 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Attempting download of 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume b129a0ea-8bc9-44c8-83a5-a27af8e4fab5. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa5b2e-228b-41d6-9a8e-030e41bcda76]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_y9zxy61m {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:50 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_y9zxy61m Sep 08 13:55:50 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:50 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 1073741824" returned: 0 in 0.628s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:50 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_y9zxy61m" returned: 0 in 0.524s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_y9zxy61m {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:50 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 Sep 08 13:55:50 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:50 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_y9zxy61m Sep 08 13:55:50 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:51 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_y9zxy61m" returned: 1 in 0.497s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_y9zxy61m' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f179c6a8-6250-4ffa-b984-04c223473b17]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:51 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5" returned: 0 in 0.516s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4701fc7c-6103-4cd6-90a6-d73db30b34d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acfe5a7-b3d6-4a96-89cc-2226dd48dada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:51 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Volume volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 (be17c7fb-b753-482f-9867-bd1cd71f6ab5): created successfully Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acfe5a7-b3d6-4a96-89cc-2226dd48dada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (c8773d53-0551-4a7e-9269-ebd6af63f13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b9eb2f4d-b71b-4c75-bc6d-0d29def37c1d tempest-VolumesSnapshotTestJSON-592573456 None] Created volume successfully. Sep 08 13:55:51 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD Sep 08 13:55:51 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:51 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f was qcow2, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 13:55:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:51 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 Sep 08 13:55:51 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Creating offline snapshot 69a9c9b9-3d27-4609-9c5e-3c906bea30e9 of volume be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:55:52 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c325d963-2ffb-4bdb-aaf5-bef5bc531590]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:52 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 Sep 08 13:55:52 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:53 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5" returned: 0 in 0.586s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:53 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 1G Sep 08 13:55:53 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:53 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 1G" returned: 0 in 0.623s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:53 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 Sep 08 13:55:53 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:54 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5" returned: 0 in 2.282s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_e6ckce0vdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:55:54 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Converted 112.00 MB image at 48.98 MB/s Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:54 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 1G Sep 08 13:55:54 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:54 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9" returned: 0 in 0.382s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:54 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 is being set with open permissions: ugo+rw Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:54 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 Sep 08 13:55:54 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:54 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 1G" returned: 0 in 0.415s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Downloaded image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f for user 0ba465bd020a41c18177579d38768c58 is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Marking volume b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 13:55:54 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9" returned: 0 in 0.314s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Copying metadata from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f to b129a0ea-8bc9-44c8-83a5-a27af8e4fab5. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Creating volume glance metadata for volume b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 backed by image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:54 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.info Sep 08 13:55:54 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa77e264-3031-4987-9ae3-02c32b43f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06e1a93-d83c-4ae6-88b5-0d82bf3a4dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:54 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Volume volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 (b129a0ea-8bc9-44c8-83a5-a27af8e4fab5): created successfully Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06e1a93-d83c-4ae6-88b5-0d82bf3a4dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (9d3a48b3-3e08-49d8-af57-ea5457c41be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ad5c6cb6-0432-4bb3-80cc-88bf3e9340d3 tempest-VolumesGetTest-372354448 None] Created volume successfully. Sep 08 13:55:54 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.info" returned: 0 in 0.336s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:54 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.info is being set with open permissions: ugo+rw Sep 08 13:55:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:54 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.info Sep 08 13:55:54 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:55 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.info" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-522e0523-c809-4bd9-b9cc-3236f4e46e4c tempest-VolumesSnapshotTestJSON-592573456 None] Create snapshot completed successfully Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (1156e763-dae0-428e-b2b9-36450e145a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0396a646-5df6-4e89-818e-0aa62eb04b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0396a646-5df6-4e89-818e-0aa62eb04b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1404995240',display_name='tempest-VolumesGetTest-Volume-945917682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a773588f-ec9b-4b28-9dac-930f3b59ef48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:56Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f1b55f-fb42-480f-ad8a-f0334f7783f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f1b55f-fb42-480f-ad8a-f0334f7783f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5eed69d-e0db-4bd6-9ba7-18957b13a127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5eed69d-e0db-4bd6-9ba7-18957b13a127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a773588f-ec9b-4b28-9dac-930f3b59ef48', 'volume_name': 'volume-a773588f-ec9b-4b28-9dac-930f3b59ef48', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7430e233-cdcf-44d3-ac61-579b6373ac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7430e233-cdcf-44d3-ac61-579b6373ac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477bf48f-952f-4001-8aa1-93c4d45236eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Volume a773588f-ec9b-4b28-9dac-930f3b59ef48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a773588f-ec9b-4b28-9dac-930f3b59ef48', 'volume_size': 1} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1404995240',display_name='tempest-VolumesGetTest-Volume-945917682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a773588f-ec9b-4b28-9dac-930f3b59ef48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10ff39e9a1b4795b0ea2ace87fad48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:56Z,use_quota=True,user_id='0ba465bd020a41c18177579d38768c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Creating volume a773588f-ec9b-4b28-9dac-930f3b59ef48 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:56 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:56 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 1073741824 Sep 08 13:55:56 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (52a1d7cc-3ead-43ab-a571-3132d7ffe247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5ddf60-ecbc-4953-bb36-346776f1bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5ddf60-ecbc-4953-bb36-346776f1bc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-999417784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b988198-4fbc-411a-a397-4ac736aece22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3387be31140949ff984f6b075e0020c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:55:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=69a9c9b9-3d27-4609-9c5e-3c906bea30e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:55:57Z,use_quota=True,user_id='ff7b968bef484f569b4a70f8570b0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f31694d-2849-4b05-a3b8-39ee1c6546e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f31694d-2849-4b05-a3b8-39ee1c6546e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10088143-cf2d-4680-939c-6f988c4c4b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10088143-cf2d-4680-939c-6f988c4c4b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b988198-4fbc-411a-a397-4ac736aece22', 'volume_name': 'volume-9b988198-4fbc-411a-a397-4ac736aece22', 'volume_size': 2, 'snapshot_id': '69a9c9b9-3d27-4609-9c5e-3c906bea30e9'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253a7f3-ce30-4fac-aec0-aadaca20a8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253a7f3-ce30-4fac-aec0-aadaca20a8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c4885b-5cd8-4dac-84c2-9dea8df5a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:56 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Volume 9b988198-4fbc-411a-a397-4ac736aece22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b988198-4fbc-411a-a397-4ac736aece22', 'volume_size': 2, 'snapshot_id': '69a9c9b9-3d27-4609-9c5e-3c906bea30e9'} Sep 08 13:55:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:57 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 1073741824" returned: 0 in 0.596s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:57 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 Sep 08 13:55:57 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:57 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48" returned: 0 in 0.347s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.773s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-69a9c9b9-3d27-4609-9c5e-3c906bea30e9-9b988198-4fbc-411a-a397-4ac736aece22" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477bf48f-952f-4001-8aa1-93c4d45236eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a773588f-ec9b-4b28-9dac-930f3b59ef48', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec944535-c1d2-4a37-8d7c-39dd79f2dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-69a9c9b9-3d27-4609-9c5e-3c906bea30e9-9b988198-4fbc-411a-a397-4ac736aece22" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Creating volume 9b988198-4fbc-411a-a397-4ac736aece22 from snapshot 69a9c9b9-3d27-4609-9c5e-3c906bea30e9 {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-9b988198-4fbc-411a-a397-4ac736aece22" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:57 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Volume volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 (a773588f-ec9b-4b28-9dac-930f3b59ef48): created successfully Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec944535-c1d2-4a37-8d7c-39dd79f2dedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Flow 'volume_create_manager' (1156e763-dae0-428e-b2b9-36450e145a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-9b988198-4fbc-411a-a397-4ac736aece22" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] snapshot: 69a9c9b9-3d27-4609-9c5e-3c906bea30e9, volume: 9b988198-4fbc-411a-a397-4ac736aece22, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 13:55:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e188f96a-1037-4066-ac86-396db25eb0ae tempest-VolumesGetTest-372354448 None] Created volume successfully. Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f12d4f7-8541-4e98-854a-882a88a52f60]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:57 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 Sep 08 13:55:57 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:58 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[28768139-d641-414f-80c9-47236a347fdc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:58 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 Sep 08 13:55:58 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:58 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5" returned: 0 in 0.393s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:58 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 Sep 08 13:55:58 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-a773588f-ec9b-4b28-9dac-930f3b59ef48-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Lock "cinder-a773588f-ec9b-4b28-9dac-930f3b59ef48-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-a773588f-ec9b-4b28-9dac-930f3b59ef48" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-a773588f-ec9b-4b28-9dac-930f3b59ef48" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1321f34f-1fda-458e-808b-69fec4055f0b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:55:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:59 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 Sep 08 13:55:59 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:55:59 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 08 13:55:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48" returned: 0 in 0.622s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:55:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:55:59 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48 Sep 08 13:55:59 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:00 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a773588f-ec9b-4b28-9dac-930f3b59ef48" returned: 0 in 0.537s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-a773588f-ec9b-4b28-9dac-930f3b59ef48" released by "delete_volume" :: held 1.229s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Created reservations ['65d482a6-8312-4432-ad51-bfea44f13aca', '54f6a6ed-4682-4412-9478-f06e5d100155', '43bf0d6a-fd36-430b-88c4-a516974f7d95', '2d4fc2d5-a8d4-47c7-b036-ad87ae61c771'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:00 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:00 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:01 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.803s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Deleted volume successfully. Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e35b9035-648d-48b0-ad3f-ccb11ab73e3b tempest-VolumesGetTest-372354448 None] Lock "cinder-a773588f-ec9b-4b28-9dac-930f3b59ef48-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Lock "cinder-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Acquiring lock "cinder-quobyte-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba70326-d40f-4547-b0a6-590b9158bcb0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:01 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 Sep 08 13:56:01 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:02 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5" returned: 0 in 0.846s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:02 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5 Sep 08 13:56:02 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:02 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5" returned: 0 in 0.533s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:02 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Lock "cinder-quobyte-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5" released by "delete_volume" :: held 1.501s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Created reservations ['d8100eb6-10de-4198-bfba-dc1bcbe001b4', '8c321959-aa3e-449d-bd59-edfe10299aa1', '33d34413-3811-426a-a7dc-e31c4a508eeb', 'e96a958a-bed7-47d8-b539-fd968ddefe67'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:03 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:03 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:03 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:03 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:04 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.734s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:04 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Deleted volume successfully. Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e6e02928-9230-42c8-ba36-39f5222d9d76 tempest-VolumesGetTest-372354448 None] Lock "cinder-b129a0ea-8bc9-44c8-83a5-a27af8e4fab5-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:04 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.969s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:56:04 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22" returned: 0 in 5.840s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:56:04 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Converted 1024.00 MB image at 175.32 MB/s Sep 08 13:56:04 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 is being set with open permissions: ugo+rw Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:04 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 Sep 08 13:56:04 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:04 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22" returned: 0 in 0.354s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-9b988198-4fbc-411a-a397-4ac736aece22" released by "_copy_volume_from_snapshot" :: held 7.048s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-69a9c9b9-3d27-4609-9c5e-3c906bea30e9-9b988198-4fbc-411a-a397-4ac736aece22" released by "_create_volume_from_snapshot" :: held 7.144s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.175s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c4885b-5cd8-4dac-84c2-9dea8df5a7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b988198-4fbc-411a-a397-4ac736aece22', 'volume_size': 2, 'snapshot_id': '69a9c9b9-3d27-4609-9c5e-3c906bea30e9'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a909a5-6321-4ee0-935f-3c42c8888fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:04 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Volume volume-9b988198-4fbc-411a-a397-4ac736aece22 (9b988198-4fbc-411a-a397-4ac736aece22): created successfully Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a909a5-6321-4ee0-935f-3c42c8888fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (52a1d7cc-3ead-43ab-a571-3132d7ffe247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:04 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7a468c86-7f68-4e43-ac9f-4ae98bfb394d tempest-VolumesSnapshotTestJSON-592573456 None] Created volume successfully. Sep 08 13:56:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-9b988198-4fbc-411a-a397-4ac736aece22-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-9b988198-4fbc-411a-a397-4ac736aece22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-9b988198-4fbc-411a-a397-4ac736aece22" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-9b988198-4fbc-411a-a397-4ac736aece22" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[44149e88-08d4-457a-ad51-5c8fac227704]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:06 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 Sep 08 13:56:06 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:06 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22" returned: 0 in 0.468s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:06 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22 Sep 08 13:56:06 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:06 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9b988198-4fbc-411a-a397-4ac736aece22" returned: 0 in 0.341s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-9b988198-4fbc-411a-a397-4ac736aece22" released by "delete_volume" :: held 0.884s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:INSERT=41,cinder:SELECT=110,cinder:UPDATE=117,cinder:DELETE=6 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=115,cinder:UPDATE=116,cinder:DELETE=12,cinder:INSERT=34 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:56:06 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Created reservations ['90ba50c0-b4ee-46ac-8443-d658adf70378', 'fa3d15db-db05-4156-87e4-4f41d17a526c', 'd935c45b-8160-4d63-97f7-515cbf910741', '41902f2d-04e0-425c-a383-7b086fc2d138'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:07 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:07 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:07 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.300s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:07 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Deleted volume successfully. Sep 08 13:56:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-290a9486-7062-45df-b060-f60aeb10c496 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-9b988198-4fbc-411a-a397-4ac736aece22-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-69a9c9b9-3d27-4609-9c5e-3c906bea30e9-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-69a9c9b9-3d27-4609-9c5e-3c906bea30e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-be17c7fb-b753-482f-9867-bd1cd71f6ab5" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-be17c7fb-b753-482f-9867-bd1cd71f6ab5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-69a9c9b9-3d27-4609-9c5e-3c906bea30e9" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-69a9c9b9-3d27-4609-9c5e-3c906bea30e9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Deleting offline snapshot 69a9c9b9-3d27-4609-9c5e-3c906bea30e9 of volume be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] snapshot_file for this snap is: volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[577699a8-acd1-43b4-8c0b-3f3b450b8230]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:08 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 Sep 08 13:56:08 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:08 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9" returned: 0 in 0.447s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5966ecf8-b3d8-4ccf-91c3-987352404d0e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:08 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 Sep 08 13:56:08 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:09 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5" returned: 0 in 0.582s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:09 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 Sep 08 13:56:09 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Flow 'volume_create_manager' (19ea95c4-e428-4840-b758-394f15ee187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021dc73d-65d0-4534-ba1f-b1965bb3ad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021dc73d-65d0-4534-ba1f-b1965bb3ad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-983358079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4c41f3-c436-4158-b6ea-1e4356599b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b96d4dec774667b8ef72946cf779dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:09Z,use_quota=True,user_id='77dedcb15ffd40828ef6ec0219e5e7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981bd1a5-741a-4516-9111-975bfd49cabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981bd1a5-741a-4516-9111-975bfd49cabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a197f7b-6afe-46c4-9a70-65d1221471a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a197f7b-6afe-46c4-9a70-65d1221471a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4c41f3-c436-4158-b6ea-1e4356599b3b', 'volume_name': 'volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b', 'volume_size': 2}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ab66c8-31f5-4154-a754-3873f54542ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ab66c8-31f5-4154-a754-3873f54542ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cacc4c6-22a6-4906-9cd1-ea287d9796a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:09 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Volume 9f4c41f3-c436-4158-b6ea-1e4356599b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b', 'volume_size': 2} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-983358079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4c41f3-c436-4158-b6ea-1e4356599b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b96d4dec774667b8ef72946cf779dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:09Z,use_quota=True,user_id='77dedcb15ffd40828ef6ec0219e5e7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Creating volume 9f4c41f3-c436-4158-b6ea-1e4356599b3b {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:56:09 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b 2147483648 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:09 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b 2147483648 Sep 08 13:56:09 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:09 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9" returned: 0 in 0.417s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:09 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9 Sep 08 13:56:09 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:09 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5.69a9c9b9-3d27-4609-9c5e-3c906bea30e9" returned: 0 in 0.275s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-69a9c9b9-3d27-4609-9c5e-3c906bea30e9" released by "_delete_snapshot" :: held 1.854s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-be17c7fb-b753-482f-9867-bd1cd71f6ab5" released by "delete_snapshot" :: held 1.882s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Created reservations ['e3be23d4-14de-4b47-bb83-8b45163fb4fa', '731eab40-fd6f-4894-88b3-b7aee38f4fbc', 'a32ad7fc-e066-49e4-97eb-cf99c4d4fad8', '2301243b-ef49-4a21-999d-991d4d2b1071'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:10 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b 2147483648" returned: 0 in 0.520s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Delete snapshot completed successfully. Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-67578869-c748-4123-b273-64a911068f9e tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-69a9c9b9-3d27-4609-9c5e-3c906bea30e9-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:10 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b Sep 08 13:56:10 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-be17c7fb-b753-482f-9867-bd1cd71f6ab5-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-be17c7fb-b753-482f-9867-bd1cd71f6ab5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-be17c7fb-b753-482f-9867-bd1cd71f6ab5" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:10 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b" returned: 0 in 0.329s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-be17c7fb-b753-482f-9867-bd1cd71f6ab5" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cacc4c6-22a6-4906-9cd1-ea287d9796a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b', 'volume_size': 2}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6689b216-357f-4cda-91f9-22a01d0fd052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae327471-f9b3-4bc8-943b-9a0500de18d1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:10 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Volume volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b (9f4c41f3-c436-4158-b6ea-1e4356599b3b): created successfully Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6689b216-357f-4cda-91f9-22a01d0fd052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Flow 'volume_create_manager' (19ea95c4-e428-4840-b758-394f15ee187d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4d1fe105-6066-4294-a9bd-3681ab371cf1 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Created volume successfully. Sep 08 13:56:10 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 Sep 08 13:56:10 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:10 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5" returned: 0 in 0.381s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:11 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5 Sep 08 13:56:11 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:11 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-be17c7fb-b753-482f-9867-bd1cd71f6ab5" returned: 0 in 0.275s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-be17c7fb-b753-482f-9867-bd1cd71f6ab5" released by "delete_volume" :: held 0.728s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Created reservations ['673b7159-e2c2-420c-9400-9ee4e9022835', '253875f8-37fe-4146-a22b-baa208c007bb', 'bbf768c5-0aee-4f6e-980b-c72c55f4b94e', '9f30ddb8-c125-42fd-b251-e5b52b867186'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:11 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:11 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:11 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.327s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Deleted volume successfully. Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-5e612dbb-d6fd-46ca-9aa3-053f94695d72 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-be17c7fb-b753-482f-9867-bd1cd71f6ab5-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Creating offline snapshot 2a03e9d8-354a-4d81-880c-a99e8b559ba7 of volume 9f4c41f3-c436-4158-b6ea-1e4356599b3b {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2977fed1-5c6e-4964-aea6-4fd4b2509cd8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:12 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b Sep 08 13:56:12 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:12 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b" returned: 0 in 0.599s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 2G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:12 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 2G Sep 08 13:56:12 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (b7b23fc3-3a5a-4e7c-ac3f-41951fcd4d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc887f9-0762-455c-ad6e-130379e200ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc887f9-0762-455c-ad6e-130379e200ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-346308965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d72722d-ef6d-4b57-a913-792c8088f2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3387be31140949ff984f6b075e0020c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:13Z,use_quota=True,user_id='ff7b968bef484f569b4a70f8570b0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50502545-0cff-4f9e-8e77-e6134a46d558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50502545-0cff-4f9e-8e77-e6134a46d558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffef9421-0b66-4358-bd90-66fdfeda22a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffef9421-0b66-4358-bd90-66fdfeda22a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d72722d-ef6d-4b57-a913-792c8088f2ec', 'volume_name': 'volume-2d72722d-ef6d-4b57-a913-792c8088f2ec', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038e724d-c28e-4533-a49b-d5accf50c267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038e724d-c28e-4533-a49b-d5accf50c267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f999c67-7350-4be3-95a8-f178dfb0472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Volume 2d72722d-ef6d-4b57-a913-792c8088f2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d72722d-ef6d-4b57-a913-792c8088f2ec', 'volume_size': 1} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-3290d72f-0ca0-4510-b42d-265caa3dbdf3 req-9b414990-f196-4998-9a08-0e09be9b6a90 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:13 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 2G" returned: 0 in 0.493s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:13 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 Sep 08 13:56:13 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:13 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7" returned: 0 in 0.343s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:13 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 is being set with open permissions: ugo+rw Sep 08 13:56:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:13 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 Sep 08 13:56:13 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:13 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7" returned: 0 in 0.255s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:13 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.info Sep 08 13:56:13 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:14 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.info" returned: 0 in 0.262s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:14 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.info is being set with open permissions: ugo+rw Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:14 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.info Sep 08 13:56:14 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:14 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.info" returned: 0 in 0.256s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-346308965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d72722d-ef6d-4b57-a913-792c8088f2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3387be31140949ff984f6b075e0020c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:13Z,use_quota=True,user_id='ff7b968bef484f569b4a70f8570b0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Creating volume 2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:56:14 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:14 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec 1073741824 Sep 08 13:56:14 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:14 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ed906595-fe35-4cd2-bab3-5721cb5137f5 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Create snapshot completed successfully Sep 08 13:56:14 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec 1073741824" returned: 0 in 0.433s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:14 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec Sep 08 13:56:14 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:15 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec" returned: 0 in 0.257s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-3290d72f-0ca0-4510-b42d-265caa3dbdf3 req-9b414990-f196-4998-9a08-0e09be9b6a90 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.242s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f999c67-7350-4be3-95a8-f178dfb0472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d72722d-ef6d-4b57-a913-792c8088f2ec', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f204b1-d926-474b-b5ba-b613efbbedbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-3290d72f-0ca0-4510-b42d-265caa3dbdf3 req-9b414990-f196-4998-9a08-0e09be9b6a90 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:15 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Volume volume-2d72722d-ef6d-4b57-a913-792c8088f2ec (2d72722d-ef6d-4b57-a913-792c8088f2ec): created successfully Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f204b1-d926-474b-b5ba-b613efbbedbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (b7b23fc3-3a5a-4e7c-ac3f-41951fcd4d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0507a324-e341-41ce-beda-22c2276738ff tempest-VolumesSnapshotTestJSON-592573456 None] Created volume successfully. Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-3290d72f-0ca0-4510-b42d-265caa3dbdf3 req-9b414990-f196-4998-9a08-0e09be9b6a90 tempest-TestInstancesWithCinderVolumes-50787398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f8d2570-c72b-4c5b-8fe9-a6b390b4482a', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:56:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-3290d72f-0ca0-4510-b42d-265caa3dbdf3 req-9b414990-f196-4998-9a08-0e09be9b6a90 tempest-TestInstancesWithCinderVolumes-50787398 None] attachment_update completed successfully. Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "cinder-2a03e9d8-354a-4d81-880c-a99e8b559ba7-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-2a03e9d8-354a-4d81-880c-a99e8b559ba7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "cinder-quobyte-9f4c41f3-c436-4158-b6ea-1e4356599b3b" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-quobyte-9f4c41f3-c436-4158-b6ea-1e4356599b3b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "cinder-quobyte-2a03e9d8-354a-4d81-880c-a99e8b559ba7" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-quobyte-2a03e9d8-354a-4d81-880c-a99e8b559ba7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Deleting offline snapshot 2a03e9d8-354a-4d81-880c-a99e8b559ba7 of volume 9f4c41f3-c436-4158-b6ea-1e4356599b3b {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] snapshot_file for this snap is: volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[634f27e9-f3d7-4a2e-93f9-a7ce2538b8b0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:15 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 Sep 08 13:56:15 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:15 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7" returned: 0 in 0.529s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb7e269-9222-4a45-a045-32773531c96e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Creating offline snapshot 38ef9746-d0f7-46d6-bb42-844bc3bde02c of volume 2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[33991ee3-3a3c-4d6f-b9f3-1560c46d0212]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:16 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b Sep 08 13:56:16 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:16 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec Sep 08 13:56:16 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:16 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b" returned: 0 in 0.517s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:16 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:16 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 Sep 08 13:56:16 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec" returned: 0 in 0.533s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:16 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c 1G Sep 08 13:56:16 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:17 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7" returned: 0 in 0.618s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:17 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7 Sep 08 13:56:17 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:17 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c 1G" returned: 0 in 0.595s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d72722d-ef6d-4b57-a913-792c8088f2ec -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:17 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d72722d-ef6d-4b57-a913-792c8088f2ec -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c Sep 08 13:56:17 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:17 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b.2a03e9d8-354a-4d81-880c-a99e8b559ba7" returned: 0 in 0.342s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-quobyte-2a03e9d8-354a-4d81-880c-a99e8b559ba7" released by "_delete_snapshot" :: held 2.181s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-quobyte-9f4c41f3-c436-4158-b6ea-1e4356599b3b" released by "delete_snapshot" :: held 2.219s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:17 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d72722d-ef6d-4b57-a913-792c8088f2ec -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c" returned: 0 in 0.387s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:17 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c is being set with open permissions: ugo+rw Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:17 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c Sep 08 13:56:17 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Created reservations ['feabbe30-adf8-4152-b64f-729fbce8b5c6', 'f4cddf34-8dba-4a97-9781-d35836859a89', '112ebf41-f9cb-401c-b626-44b45ff97a25', '0078ac5c-c543-4948-9f5b-aedee914bef6'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Delete snapshot completed successfully. Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4ea8f56b-3be3-46aa-9b12-3fd11fab46a7 tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-2a03e9d8-354a-4d81-880c-a99e8b559ba7-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:17 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c" returned: 0 in 0.287s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:17 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.info Sep 08 13:56:17 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:18 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.info" returned: 0 in 0.296s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:18 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.info is being set with open permissions: ugo+rw Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:18 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.info Sep 08 13:56:18 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-56670a48-fbb4-45c8-8fbb-efd27c33d698 req-b116f931-c7e3-4aab-a9af-e13a01934933 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:18 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.info" returned: 0 in 0.300s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-56670a48-fbb4-45c8-8fbb-efd27c33d698 req-b116f931-c7e3-4aab-a9af-e13a01934933 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.193s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-56670a48-fbb4-45c8-8fbb-efd27c33d698 req-b116f931-c7e3-4aab-a9af-e13a01934933 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "cinder-9f4c41f3-c436-4158-b6ea-1e4356599b3b-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-37e07173-7a23-4e17-8441-cacee6b98305 tempest-VolumesSnapshotTestJSON-592573456 None] Create snapshot completed successfully Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-9f4c41f3-c436-4158-b6ea-1e4356599b3b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-56670a48-fbb4-45c8-8fbb-efd27c33d698 req-b116f931-c7e3-4aab-a9af-e13a01934933 tempest-TestInstancesWithCinderVolumes-50787398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-d56fe956-2503-4a7f-b2f0-bb8416c30283', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd3d3364-14dc-43c8-a806-db7d2252a6f7', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "cinder-quobyte-9f4c41f3-c436-4158-b6ea-1e4356599b3b" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-quobyte-9f4c41f3-c436-4158-b6ea-1e4356599b3b" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[65427f2d-e9e1-4a18-bfba-b3829ff719ad]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-56670a48-fbb4-45c8-8fbb-efd27c33d698 req-b116f931-c7e3-4aab-a9af-e13a01934933 tempest-TestInstancesWithCinderVolumes-50787398 None] attachment_update completed successfully. Sep 08 13:56:18 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b Sep 08 13:56:18 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:19 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b" returned: 0 in 0.622s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:19 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b Sep 08 13:56:19 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:19 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f4c41f3-c436-4158-b6ea-1e4356599b3b" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-quobyte-9f4c41f3-c436-4158-b6ea-1e4356599b3b" released by "delete_volume" :: held 1.081s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:19 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Created reservations ['fc4232ee-2b67-4425-b6d4-3f406dced2fa', 'a4b66a86-8dcc-40db-9e3c-00e826511113', 'eb37f84a-f2d3-46fa-98cf-406958475057', 'ec7530c0-047c-4183-9e37-9d1d2341c29e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:19 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (687eeb4c-9d34-4375-9062-df4602052635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00f37f2-4d0d-46c4-b32f-7f0928bc891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00f37f2-4d0d-46c4-b32f-7f0928bc891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-200546187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1027b55d-6bf0-42f5-bad8-bb44598031b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3387be31140949ff984f6b075e0020c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38ef9746-d0f7-46d6-bb42-844bc3bde02c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:20Z,use_quota=True,user_id='ff7b968bef484f569b4a70f8570b0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d4c66b-a1b4-493e-af12-cb60c017e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d4c66b-a1b4-493e-af12-cb60c017e668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:20 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:20 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e09f60-aeb3-43be-a830-30f24a009067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e09f60-aeb3-43be-a830-30f24a009067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1027b55d-6bf0-42f5-bad8-bb44598031b9', 'volume_name': 'volume-1027b55d-6bf0-42f5-bad8-bb44598031b9', 'volume_size': 1, 'snapshot_id': '38ef9746-d0f7-46d6-bb42-844bc3bde02c'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7c08d6-fc72-4252-98bb-0c14622de2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7c08d6-fc72-4252-98bb-0c14622de2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4ec324-28bd-4c41-a313-29051bc2bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Volume 1027b55d-6bf0-42f5-bad8-bb44598031b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1027b55d-6bf0-42f5-bad8-bb44598031b9', 'volume_size': 1, 'snapshot_id': '38ef9746-d0f7-46d6-bb42-844bc3bde02c'} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-38ef9746-d0f7-46d6-bb42-844bc3bde02c-1027b55d-6bf0-42f5-bad8-bb44598031b9" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-38ef9746-d0f7-46d6-bb42-844bc3bde02c-1027b55d-6bf0-42f5-bad8-bb44598031b9" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Creating volume 1027b55d-6bf0-42f5-bad8-bb44598031b9 from snapshot 38ef9746-d0f7-46d6-bb42-844bc3bde02c {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-1027b55d-6bf0-42f5-bad8-bb44598031b9" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-1027b55d-6bf0-42f5-bad8-bb44598031b9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] snapshot: 38ef9746-d0f7-46d6-bb42-844bc3bde02c, volume: 1027b55d-6bf0-42f5-bad8-bb44598031b9, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e30a3b3-274a-478c-bb77-0f94537d3d59]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:20 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.310s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Deleted volume successfully. Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f85ff54e-ac70-4092-bea2-4201c4337a2b tempest-VolumesSnapshotNegativeTestJSON-1251335423 None] Lock "cinder-9f4c41f3-c436-4158-b6ea-1e4356599b3b-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:20 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c Sep 08 13:56:20 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:20 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c" returned: 0 in 0.438s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d72722d-ef6d-4b57-a913-792c8088f2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[104837af-0cd0-47b9-873b-aa333bed911f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:20 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec Sep 08 13:56:20 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:21 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec" returned: 0 in 0.474s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 13:56:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 13:56:21 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 13:56:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:21 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 Sep 08 13:56:21 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-93de12f0-d8d3-4a9b-bd09-4aae41decd51 req-9c6ee91a-a831-4a85-9b49-ac94e248154c tempest-TestInstancesWithCinderVolumes-50787398 None] Terminate volume connection completed successfully. Sep 08 13:56:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-93de12f0-d8d3-4a9b-bd09-4aae41decd51 req-9c6ee91a-a831-4a85-9b49-ac94e248154c tempest-TestInstancesWithCinderVolumes-50787398 None] Deleting attachment 1f8d2570-c72b-4c5b-8fe9-a6b390b4482a. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:56:27 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9" returned: 0 in 6.712s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:27 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:56:27 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Converted 1024.00 MB image at 152.54 MB/s Sep 08 13:56:27 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 is being set with open permissions: ugo+rw Sep 08 13:56:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:27 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 Sep 08 13:56:27 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:28 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-1027b55d-6bf0-42f5-bad8-bb44598031b9" released by "_copy_volume_from_snapshot" :: held 8.014s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-38ef9746-d0f7-46d6-bb42-844bc3bde02c-1027b55d-6bf0-42f5-bad8-bb44598031b9" released by "_create_volume_from_snapshot" :: held 8.106s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.139s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4ec324-28bd-4c41-a313-29051bc2bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1027b55d-6bf0-42f5-bad8-bb44598031b9', 'volume_size': 1, 'snapshot_id': '38ef9746-d0f7-46d6-bb42-844bc3bde02c'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebafcf6-ba1d-448b-9e81-0c5e4c1422fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:28 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Volume volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 (1027b55d-6bf0-42f5-bad8-bb44598031b9): created successfully Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebafcf6-ba1d-448b-9e81-0c5e4c1422fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Flow 'volume_create_manager' (687eeb4c-9d34-4375-9062-df4602052635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-aa2d982a-523e-4cf3-82fd-5fae2bdc058f tempest-VolumesSnapshotTestJSON-592573456 None] Created volume successfully. Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "cinder-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "cinder-quobyte-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-quobyte-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ba00d0-895d-46d2-a3b2-18b93b7ef0cc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:28 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 Sep 08 13:56:28 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:29 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085" returned: 0 in 0.467s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:29 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085 Sep 08 13:56:29 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-1027b55d-6bf0-42f5-bad8-bb44598031b9-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-1027b55d-6bf0-42f5-bad8-bb44598031b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:29 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085" returned: 0 in 0.444s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-1027b55d-6bf0-42f5-bad8-bb44598031b9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-quobyte-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085" released by "delete_volume" :: held 0.973s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-1027b55d-6bf0-42f5-bad8-bb44598031b9" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc269447-8a1a-4443-8366-86534c13dddd]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:29 devstack cinder-volume[87262]: WARNING cinder.quota [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517975408-1659095089 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517975408-1659095089, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:56:29 devstack cinder-volume[87262]: WARNING cinder.quota [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517975408-1659095089 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517975408-1659095089, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Created reservations ['236b5207-d03c-412e-bf89-bd964f77aa9f', 'e1e50a65-ac66-4678-b4a7-bfd7a21c1352', 'cd82e730-3ba0-4c9b-b922-12bd44f2ef5f', '5c8837d8-08c0-459a-8508-b7c22561fcd1'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:29 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 Sep 08 13:56:29 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:29 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:29 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:30 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9" returned: 0 in 0.579s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:30 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.411s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:30 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9 Sep 08 13:56:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Deleted volume successfully. Sep 08 13:56:30 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3ed3444f-0a30-4a41-871d-73608b7ce6b3 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-3dc85e96-3a3f-4eca-b8a9-ff7fb1ae0085-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:30 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1027b55d-6bf0-42f5-bad8-bb44598031b9" returned: 0 in 0.463s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-1027b55d-6bf0-42f5-bad8-bb44598031b9" released by "delete_volume" :: held 1.107s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Created reservations ['a7fb57f5-5131-42fa-9255-c283d41dfd09', '9bfe4892-ecdb-4500-9f40-84222c2dbac3', '3d8fc3e2-67bf-46e9-bca5-f63b42b7805c', '8182988f-a2aa-4a6d-a830-746bfbaddee5'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:30 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:30 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:31 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.307s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Deleted volume successfully. Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-829e39d9-6fb0-4288-90da-c8d0a52ff8ab tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-1027b55d-6bf0-42f5-bad8-bb44598031b9-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-38ef9746-d0f7-46d6-bb42-844bc3bde02c-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-38ef9746-d0f7-46d6-bb42-844bc3bde02c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-2d72722d-ef6d-4b57-a913-792c8088f2ec" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-2d72722d-ef6d-4b57-a913-792c8088f2ec" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-38ef9746-d0f7-46d6-bb42-844bc3bde02c" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-38ef9746-d0f7-46d6-bb42-844bc3bde02c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Deleting offline snapshot 38ef9746-d0f7-46d6-bb42-844bc3bde02c of volume 2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] snapshot_file for this snap is: volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0620ccc-a324-4dd6-83c7-ed18d05e7a37]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:32 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c Sep 08 13:56:32 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:32 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c" returned: 0 in 0.594s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d72722d-ef6d-4b57-a913-792c8088f2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:56:32 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd52b76f-c75f-4364-a230-87ffda6cd64c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:32 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec Sep 08 13:56:32 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:33 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-26f98b79-1da7-4fb7-9338-1ac1dd17c781 req-03549b47-516c-4f43-9f83-196cb35079b7 tempest-TestInstancesWithCinderVolumes-50787398 None] Terminate volume connection completed successfully. Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-26f98b79-1da7-4fb7-9338-1ac1dd17c781 req-03549b47-516c-4f43-9f83-196cb35079b7 tempest-TestInstancesWithCinderVolumes-50787398 None] Deleting attachment bd3d3364-14dc-43c8-a806-db7d2252a6f7. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:56:33 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec" returned: 0 in 0.714s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:33 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c Sep 08 13:56:33 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "cinder-d56fe956-2503-4a7f-b2f0-bb8416c30283-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:33 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-d56fe956-2503-4a7f-b2f0-bb8416c30283-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c" returned: 0 in 0.550s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:33 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c Sep 08 13:56:33 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "cinder-quobyte-d56fe956-2503-4a7f-b2f0-bb8416c30283" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-quobyte-d56fe956-2503-4a7f-b2f0-bb8416c30283" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b66c517-e685-4d9e-9471-8c771c0db916]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:34 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec.38ef9746-d0f7-46d6-bb42-844bc3bde02c" returned: 0 in 0.389s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:34 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 Sep 08 13:56:34 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-38ef9746-d0f7-46d6-bb42-844bc3bde02c" released by "_delete_snapshot" :: held 2.443s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-2d72722d-ef6d-4b57-a913-792c8088f2ec" released by "delete_snapshot" :: held 2.479s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Created reservations ['e9decd72-cbf5-4053-8a13-b80bdb81ae57', 'e978706f-a62e-4cd3-90e6-c2452eb2ff23', 'fca90466-0ccd-4b41-a109-68304ac7b368', '5fc0fef7-62f7-47c5-aac9-24cd2bf00424'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Delete snapshot completed successfully. Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6eb8652e-6f88-4a75-878c-a0db449d7e2d tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-38ef9746-d0f7-46d6-bb42-844bc3bde02c-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:34 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283" returned: 0 in 0.693s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:34 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283 Sep 08 13:56:34 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Flow 'volume_create_manager' (6a769651-dcf3-485d-8344-1a878db164fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ec7f2a-07bb-44e0-824e-91d7e009ebb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ec7f2a-07bb-44e0-824e-91d7e009ebb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a4703a-dfea-48fc-a54c-182b994246a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38aae7be41c4b319f10b40b5df9c86d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:35Z,use_quota=True,user_id='c8bf97a71d574e42ba989fb0c5767614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(464b60f6-e2ff-45a0-9aac-34193b72c1a7),volume_type_id=464b60f6-e2ff-45a0-9aac-34193b72c1a7)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8afcdf8-5462-4a62-a895-f6d20ca091b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8afcdf8-5462-4a62-a895-f6d20ca091b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd17fe0a-af1f-4fe5-ad9e-f6069dfa7702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:34 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 13:56:35 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d56fe956-2503-4a7f-b2f0-bb8416c30283" returned: 0 in 0.363s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-quobyte-d56fe956-2503-4a7f-b2f0-bb8416c30283" released by "delete_volume" :: held 1.145s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:35 devstack cinder-volume[87262]: WARNING cinder.quota [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1544816556-1823070892 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1544816556-1823070892, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:56:35 devstack cinder-volume[87262]: WARNING cinder.quota [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1544816556-1823070892 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1544816556-1823070892, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Created reservations ['40fe6cfd-6dd8-4d7e-906d-79bd5f52f795', '42378a78-d470-4897-8d17-2c55b0e1a033', 'eefb9595-d347-4a74-bcb2-286f8d7feb95', 'e48906af-d92d-4576-9e14-8e2ada58266b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd17fe0a-af1f-4fe5-ad9e-f6069dfa7702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36a4703a-dfea-48fc-a54c-182b994246a9', 'volume_name': 'volume-36a4703a-dfea-48fc-a54c-182b994246a9', 'volume_size': 1, 'image_id': 'f0f59834-5201-4c81-9881-95a64bda6dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0f59834-5201-4c81-9881-95a64bda6dc1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a3cffc70dc00bed4561b7a3f3965fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a38aae7be41c4b319f10b40b5df9c86d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86c836d7d7bf94f049d30be02b2995664aa0ade1b2cfad17997d75ffd04834dbef05fed70a9768866bd847e472ab5cfb2da45e7ec14a66cbf97c3a66fb68e522', 'id': 'f0f59834-5201-4c81-9881-95a64bda6dc1', 'created_at': datetime.datetime(2026, 9, 8, 11, 56, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 56, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0f59834-5201-4c81-9881-95a64bda6dc1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5efc1c-8f25-4744-8b09-929747a1cce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5efc1c-8f25-4744-8b09-929747a1cce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616ba1b5-d17c-4cb2-b059-6bb1f7b3c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:35 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Volume 36a4703a-dfea-48fc-a54c-182b994246a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36a4703a-dfea-48fc-a54c-182b994246a9', 'volume_size': 1, 'image_id': 'f0f59834-5201-4c81-9881-95a64bda6dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0f59834-5201-4c81-9881-95a64bda6dc1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a3cffc70dc00bed4561b7a3f3965fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a38aae7be41c4b319f10b40b5df9c86d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86c836d7d7bf94f049d30be02b2995664aa0ade1b2cfad17997d75ffd04834dbef05fed70a9768866bd847e472ab5cfb2da45e7ec14a66cbf97c3a66fb68e522', 'id': 'f0f59834-5201-4c81-9881-95a64bda6dc1', 'created_at': datetime.datetime(2026, 9, 8, 11, 56, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 56, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0f59834-5201-4c81-9881-95a64bda6dc1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Trying to clone 36a4703a-dfea-48fc-a54c-182b994246a9 from image f0f59834-5201-4c81-9881-95a64bda6dc1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0f59834-5201-4c81-9881-95a64bda6dc1', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-2d72722d-ef6d-4b57-a913-792c8088f2ec-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-2d72722d-ef6d-4b57-a913-792c8088f2ec-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:35 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:35 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-2d72722d-ef6d-4b57-a913-792c8088f2ec" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-2d72722d-ef6d-4b57-a913-792c8088f2ec" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 13:56:35 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Image download 0.00 MB at 0.00 MB/s Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dd5154-bd11-4837-9ae1-ad1a26bbc826]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cab4ac-2572-40f5-b4ae-7c4cdf5454dd]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:35 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec Sep 08 13:56:35 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:35 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD Sep 08 13:56:35 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:35 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.458s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:35 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Deleted volume successfully. Sep 08 13:56:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85e1e9fc-4311-43d8-859b-087bf588c258 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-d56fe956-2503-4a7f-b2f0-bb8416c30283-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:36 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:36 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec" returned: 0 in 0.522s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:36 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec Sep 08 13:56:36 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:36 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD Sep 08 13:56:36 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:36 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Temporary image f0f59834-5201-4c81-9881-95a64bda6dc1 is fetched for user c8bf97a71d574e42ba989fb0c5767614. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 13:56:36 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2d72722d-ef6d-4b57-a913-792c8088f2ec" returned: 0 in 0.442s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-2d72722d-ef6d-4b57-a913-792c8088f2ec" released by "delete_volume" :: held 1.068s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1503e93-26e3-4a05-8ab6-31bb781c4b60]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Created reservations ['7642eed0-00e7-4112-b7e0-68475c8b2d00', 'ec69bb39-49a1-459a-94b9-d21c3612f0ef', 'c5d902d1-b12e-40d9-995c-8411077eef73', 'a536df3f-e9fd-449d-b721-3e4fa82f622f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:36 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD Sep 08 13:56:36 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:36 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:36 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:37 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:37 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD Sep 08 13:56:37 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:37 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.468s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:37 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Deleted volume successfully. Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-452e3736-06e0-46c3-afa1-a330656c2006 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-2d72722d-ef6d-4b57-a913-792c8088f2ec-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:37 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD" returned: 1 in 0.533s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a4703a-dfea-48fc-a54c-182b994246a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38aae7be41c4b319f10b40b5df9c86d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:35Z,use_quota=True,user_id='c8bf97a71d574e42ba989fb0c5767614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(464b60f6-e2ff-45a0-9aac-34193b72c1a7),volume_type_id=464b60f6-e2ff-45a0-9aac-34193b72c1a7)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Creating volume 36a4703a-dfea-48fc-a54c-182b994246a9 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:56:37 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:37 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 1073741824 Sep 08 13:56:37 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-b350d38a-e6d8-489b-9788-97dc5c9c432f-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-b350d38a-e6d8-489b-9788-97dc5c9c432f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "cinder-quobyte-b350d38a-e6d8-489b-9788-97dc5c9c432f" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-b350d38a-e6d8-489b-9788-97dc5c9c432f" acquired by "delete_volume" :: waited 0.035s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c93f43a-d013-4dab-983a-0a5fcbe32d7c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:38 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f Sep 08 13:56:38 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:38 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 1073741824" returned: 0 in 0.655s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:38 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 Sep 08 13:56:38 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:38 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f" returned: 0 in 0.502s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:38 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f Sep 08 13:56:38 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:38 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9" returned: 0 in 0.348s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Attempting download of f0f59834-5201-4c81-9881-95a64bda6dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0f59834-5201-4c81-9881-95a64bda6dc1', 'metadata': {}}])) to volume 36a4703a-dfea-48fc-a54c-182b994246a9. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a563b143-5b80-4db5-a0a8-386bab51ef9f]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0f59834-5201-4c81-9881-95a64bda6dc1_ppn2k6az {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:39 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b350d38a-e6d8-489b-9788-97dc5c9c432f" returned: 0 in 0.403s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-quobyte-b350d38a-e6d8-489b-9788-97dc5c9c432f" released by "delete_volume" :: held 1.028s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:39 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0f59834-5201-4c81-9881-95a64bda6dc1_ppn2k6az Sep 08 13:56:39 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Created reservations ['65e6950d-1032-4e60-9215-a12326799189', 'da4fd5a9-1f8e-42e9-a195-11648a3b6901', 'd3c3858f-5d9b-4c69-abe1-2f34d790c994', 'c8754216-1113-4526-9eb5-d28fdeedceca'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:39 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:39 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:39 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0f59834-5201-4c81-9881-95a64bda6dc1_ppn2k6az" returned: 0 in 0.545s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0f59834-5201-4c81-9881-95a64bda6dc1_ppn2k6az {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:39 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:39 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0f59834-5201-4c81-9881-95a64bda6dc1_ppn2k6az Sep 08 13:56:39 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.361s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:39 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Deleted volume successfully. Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8e83f7b1-e060-430b-bbb4-1750293d12e7 tempest-VolumesSnapshotTestJSON-592573456 None] Lock "cinder-b350d38a-e6d8-489b-9788-97dc5c9c432f-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:39 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0f59834-5201-4c81-9881-95a64bda6dc1_ppn2k6az" returned: 1 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0f59834-5201-4c81-9881-95a64bda6dc1_ppn2k6az' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[730693ad-c9b0-4890-9a9a-510583687946]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:40 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD Sep 08 13:56:40 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:40 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:40 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD Sep 08 13:56:40 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:41 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD" returned: 1 in 0.656s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:56:41 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] f0f59834-5201-4c81-9881-95a64bda6dc1 was raw, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 13:56:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:41 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 Sep 08 13:56:41 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:41 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9" returned: 0 in 0.728s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:41 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0f59834-5201-4c81-9881-95a64bda6dc1_xpqsffuqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:56:41 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 13:56:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-04a6398d-8f60-41cb-b42b-6276d164fdf1 req-9facee3b-f88a-4041-8f96-9440acec881c tempest-TestInstancesWithCinderVolumes-50787398 None] Terminate volume connection completed successfully. Sep 08 13:56:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-04a6398d-8f60-41cb-b42b-6276d164fdf1 req-9facee3b-f88a-4041-8f96-9440acec881c tempest-TestInstancesWithCinderVolumes-50787398 None] Deleting attachment 7bb285cf-b843-4498-af7c-813888108c04. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:56:41 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 1G Sep 08 13:56:41 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:42 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 1G" returned: 0 in 0.482s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Downloaded image f0f59834-5201-4c81-9881-95a64bda6dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0f59834-5201-4c81-9881-95a64bda6dc1', 'metadata': {}}])) to volume 36a4703a-dfea-48fc-a54c-182b994246a9 successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Temporary image f0f59834-5201-4c81-9881-95a64bda6dc1 for user c8bf97a71d574e42ba989fb0c5767614 is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Marking volume 36a4703a-dfea-48fc-a54c-182b994246a9 as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Copying metadata from image f0f59834-5201-4c81-9881-95a64bda6dc1 to 36a4703a-dfea-48fc-a54c-182b994246a9. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Creating volume glance metadata for volume 36a4703a-dfea-48fc-a54c-182b994246a9 backed by image f0f59834-5201-4c81-9881-95a64bda6dc1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f0f59834-5201-4c81-9881-95a64bda6dc1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd2a3cffc70dc00bed4561b7a3f3965fb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616ba1b5-d17c-4cb2-b059-6bb1f7b3c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a4703a-dfea-48fc-a54c-182b994246a9', 'volume_size': 1, 'image_id': 'f0f59834-5201-4c81-9881-95a64bda6dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0f59834-5201-4c81-9881-95a64bda6dc1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a3cffc70dc00bed4561b7a3f3965fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a38aae7be41c4b319f10b40b5df9c86d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86c836d7d7bf94f049d30be02b2995664aa0ade1b2cfad17997d75ffd04834dbef05fed70a9768866bd847e472ab5cfb2da45e7ec14a66cbf97c3a66fb68e522', 'id': 'f0f59834-5201-4c81-9881-95a64bda6dc1', 'created_at': datetime.datetime(2026, 9, 8, 11, 56, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 56, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0f59834-5201-4c81-9881-95a64bda6dc1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3b57c8-604d-4736-9774-f330304ad03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:42 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Volume volume-36a4703a-dfea-48fc-a54c-182b994246a9 (36a4703a-dfea-48fc-a54c-182b994246a9): created successfully Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3b57c8-604d-4736-9774-f330304ad03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:42 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Flow 'volume_create_manager' (6a769651-dcf3-485d-8344-1a878db164fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b72b0cca-95a9-46fb-a240-f66e83fb8d8e tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Created volume successfully. Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "cinder-4d34efb8-536e-4c8b-a6e7-57467e4cae39-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-4d34efb8-536e-4c8b-a6e7-57467e4cae39-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "cinder-quobyte-4d34efb8-536e-4c8b-a6e7-57467e4cae39" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-quobyte-4d34efb8-536e-4c8b-a6e7-57467e4cae39" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7daa09-22e9-4339-aba5-c8b57c337a59]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:43 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 Sep 08 13:56:43 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:43 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39" returned: 0 in 0.416s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:43 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39 Sep 08 13:56:43 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Acquiring lock "cinder-36a4703a-dfea-48fc-a54c-182b994246a9-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "cinder-36a4703a-dfea-48fc-a54c-182b994246a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Acquiring lock "cinder-quobyte-36a4703a-dfea-48fc-a54c-182b994246a9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "cinder-quobyte-36a4703a-dfea-48fc-a54c-182b994246a9" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d409dc90-c248-425d-8bf1-03c780d351fc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:44 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4d34efb8-536e-4c8b-a6e7-57467e4cae39" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:44 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 Sep 08 13:56:44 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-quobyte-4d34efb8-536e-4c8b-a6e7-57467e4cae39" released by "delete_volume" :: held 0.873s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:44 devstack cinder-volume[87262]: WARNING cinder.quota [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-525021685-16697004 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-525021685-16697004, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:56:44 devstack cinder-volume[87262]: WARNING cinder.quota [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-525021685-16697004 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-525021685-16697004, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Created reservations ['17ec0d5a-6710-4615-a516-f9fc52fc90d4', 'a03e68ec-c505-4710-8272-2263cdbad7ec', 'd9767fea-a377-4766-9400-dc93642a1835', '29fefe64-8510-4570-83f3-4fb31ec11bb9'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:44 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:44 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:44 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9" returned: 0 in 0.752s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:44 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9 Sep 08 13:56:44 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:44 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.403s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Deleted volume successfully. Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e01531d-22f9-447d-8f11-1a61a40616e2 tempest-TestInstancesWithCinderVolumes-50787398 None] Lock "cinder-4d34efb8-536e-4c8b-a6e7-57467e4cae39-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:44 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-36a4703a-dfea-48fc-a54c-182b994246a9" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "cinder-quobyte-36a4703a-dfea-48fc-a54c-182b994246a9" released by "delete_volume" :: held 1.192s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:45 devstack cinder-volume[87262]: WARNING cinder.quota [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:56:45 devstack cinder-volume[87262]: WARNING cinder.quota [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Created reservations ['9f540061-3a9b-47ad-a1f2-e1f6139919e8', '11e5368d-a635-466b-bf29-711b35336a17', '5bce02ee-a630-4c9d-9ceb-608ada39c07f', '8d24e6e4-bd6b-4b52-abdb-10af65a08173'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:45 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:56:45 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:45 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.466s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:56:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Deleted volume successfully. Sep 08 13:56:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c166ddd-73b5-44fd-a7f2-aa55318f81c4 tempest-VolumeAndVolumeTypeFromImageTest-313692774 None] Lock "cinder-36a4703a-dfea-48fc-a54c-182b994246a9-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:56:55 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:INSERT=31,cinder:UPDATE=112,cinder:SELECT=111,cinder:DELETE=6 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:56:55 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=95,cinder:INSERT=37,cinder:UPDATE=119,cinder:DELETE=10 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Flow 'volume_create_manager' (723e6f08-9af4-40d4-a82a-925edc9c086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba24471c-e853-4995-b868-7119bc96296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba24471c-e853-4995-b868-7119bc96296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0a1ce2-a08a-4ee2-8d02-72554128c503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454f898c16f7400cbc4286e2ac270cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:57Z,use_quota=True,user_id='e643859ae4094046afb389cbbbeb9322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7595ca1a-1698-404e-a8b7-c0d513432b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7595ca1a-1698-404e-a8b7-c0d513432b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60752578-34e6-4727-ab6e-fce0112deba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60752578-34e6-4727-ab6e-fce0112deba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d0a1ce2-a08a-4ee2-8d02-72554128c503', 'volume_name': 'volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503', 'volume_size': 1, 'image_id': '807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '68c16257c4960eb3829ffa413af2f630', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '454f898c16f7400cbc4286e2ac270cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13f23be08cce5b59a3c68dcffbea17ce2ecdd12cdb296250c58ee8cebfbf7c981e5fcde9ceea5f76ad6243cfe09664f44f73067581b34283cf7950711ac3096e', 'id': '807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'created_at': datetime.datetime(2026, 9, 8, 11, 56, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 56, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24/file', 'properties': {}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2858a092-fb64-4df1-8908-ce7896195eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2858a092-fb64-4df1-8908-ce7896195eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e88125-0f75-46ae-940d-db524e224d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:57 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Volume 3d0a1ce2-a08a-4ee2-8d02-72554128c503: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503', 'volume_size': 1, 'image_id': '807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '68c16257c4960eb3829ffa413af2f630', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '454f898c16f7400cbc4286e2ac270cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13f23be08cce5b59a3c68dcffbea17ce2ecdd12cdb296250c58ee8cebfbf7c981e5fcde9ceea5f76ad6243cfe09664f44f73067581b34283cf7950711ac3096e', 'id': '807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'created_at': datetime.datetime(2026, 9, 8, 11, 56, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 56, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24/file', 'properties': {}}, 'image_service': } Sep 08 13:56:57 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Trying to clone 3d0a1ce2-a08a-4ee2-8d02-72554128c503 from image 807cd7fb-4517-40d9-a8ad-bdcfb4beec24 at location (None, [{'url': 'file:///opt/stack/data/glance/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 13:56:58 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 13:56:58 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Image download 0.00 MB at 0.00 MB/s Sep 08 13:56:58 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[50477304-6ee1-4277-a221-3660f0781dec]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:58 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD Sep 08 13:56:58 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:58 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:56:59 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD Sep 08 13:56:59 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (e0184d80-469b-418c-bb78-05ddf304778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40c7d56-6d83-412f-9887-effba7a9f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40c7d56-6d83-412f-9887-effba7a9f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1987558133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d4a624-1ebf-4bca-9450-efe341b90015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:59Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85abd3cd-cfdb-4bc6-9d72-7acc27ee9c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85abd3cd-cfdb-4bc6-9d72-7acc27ee9c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec653f51-9aad-432f-b235-418d23ca0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec653f51-9aad-432f-b235-418d23ca0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d4a624-1ebf-4bca-9450-efe341b90015', 'volume_name': 'volume-16d4a624-1ebf-4bca-9450-efe341b90015', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5d2e84-5bf5-4953-afe6-32f220d6d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5d2e84-5bf5-4953-afe6-32f220d6d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7741da7b-9c49-4bf6-8229-5a168a252848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:56:59 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Volume 16d4a624-1ebf-4bca-9450-efe341b90015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d4a624-1ebf-4bca-9450-efe341b90015', 'volume_size': 1} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1987558133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d4a624-1ebf-4bca-9450-efe341b90015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:59Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Creating volume 16d4a624-1ebf-4bca-9450-efe341b90015 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:56:59 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:56:59 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 1073741824 Sep 08 13:56:59 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:56:59 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD" returned: 1 in 0.584s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Temporary image 807cd7fb-4517-40d9-a8ad-bdcfb4beec24 is fetched for user e643859ae4094046afb389cbbbeb9322. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aff2bdc-e80f-49ba-a06e-f82a9835afdf]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:56:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:00 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD Sep 08 13:57:00 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:00 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:00 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 1073741824" returned: 0 in 1.114s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:00 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD Sep 08 13:57:00 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:00 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 Sep 08 13:57:00 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:00 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD" returned: 1 in 0.505s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:00 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015" returned: 0 in 0.416s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0a1ce2-a08a-4ee2-8d02-72554128c503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454f898c16f7400cbc4286e2ac270cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:56:57Z,use_quota=True,user_id='e643859ae4094046afb389cbbbeb9322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Creating volume 3d0a1ce2-a08a-4ee2-8d02-72554128c503 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:00 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7741da7b-9c49-4bf6-8229-5a168a252848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d4a624-1ebf-4bca-9450-efe341b90015', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8f3246-2450-473f-860d-a4051bb25810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:01 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 1073741824 Sep 08 13:57:01 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:01 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Volume volume-16d4a624-1ebf-4bca-9450-efe341b90015 (16d4a624-1ebf-4bca-9450-efe341b90015): created successfully Sep 08 13:57:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8f3246-2450-473f-860d-a4051bb25810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (e0184d80-469b-418c-bb78-05ddf304778f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-769fc30b-5dab-4037-8356-2f8e4c0f15d5 tempest-VolumesActionsTest-1003738196 None] Created volume successfully. Sep 08 13:57:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82a6a7f9-2a87-40ca-bc1a-755b1b4032c5 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015" by "attach_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82a6a7f9-2a87-40ca-bc1a-755b1b4032c5 tempest-VolumesActionsTest-1003738196 None] Lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015" acquired by "attach_volume" :: waited 0.038s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-82a6a7f9-2a87-40ca-bc1a-755b1b4032c5 tempest-VolumesActionsTest-1003738196 None] Attaching volume 16d4a624-1ebf-4bca-9450-efe341b90015 to instance 2d455f60-b934-4111-9429-cbfadd4ecb49 at mountpoint /dev/vdb on host None. Sep 08 13:57:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-82a6a7f9-2a87-40ca-bc1a-755b1b4032c5 tempest-VolumesActionsTest-1003738196 None] Attach volume completed successfully. Sep 08 13:57:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82a6a7f9-2a87-40ca-bc1a-755b1b4032c5 tempest-VolumesActionsTest-1003738196 None] Lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015" released by "attach_volume" :: held 0.171s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:01 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 1073741824" returned: 0 in 0.943s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:01 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 Sep 08 13:57:02 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:02 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503" returned: 0 in 0.592s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:02 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Attempting download of 807cd7fb-4517-40d9-a8ad-bdcfb4beec24 ((None, [{'url': 'file:///opt/stack/data/glance/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'metadata': {}}])) to volume 3d0a1ce2-a08a-4ee2-8d02-72554128c503. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 13:57:02 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109a092-0026-42d9-a0de-6f956d450691]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_i5ws0zbf {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:02 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_i5ws0zbf Sep 08 13:57:02 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:02 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d014784d-6e00-4609-9fb1-1583b3777737 tempest-VolumesActionsTest-1577562661 None] Terminate volume connection completed successfully. Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d014784d-6e00-4609-9fb1-1583b3777737 tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-detach_volume" by "detach_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d014784d-6e00-4609-9fb1-1583b3777737 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-detach_volume" acquired by "detach_volume" :: waited 0.059s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:03 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d014784d-6e00-4609-9fb1-1583b3777737 tempest-VolumesActionsTest-1577562661 None] Detaching volume 16d4a624-1ebf-4bca-9450-efe341b90015 from instance 2d455f60-b934-4111-9429-cbfadd4ecb49. Sep 08 13:57:03 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:03 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:03 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d014784d-6e00-4609-9fb1-1583b3777737 tempest-VolumesActionsTest-1577562661 None] Detach volume completed successfully. Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d014784d-6e00-4609-9fb1-1583b3777737 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-detach_volume" released by "detach_volume" :: held 0.232s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:03 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_i5ws0zbf" returned: 0 in 0.663s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_i5ws0zbf {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e958cc19-f1e2-4a0e-a885-e769c87c8d19 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-detach_volume" by "detach_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:03 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:03 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_i5ws0zbf Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.528s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:03 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e958cc19-f1e2-4a0e-a885-e769c87c8d19 tempest-VolumesActionsTest-1003738196 None] Lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:03 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e958cc19-f1e2-4a0e-a885-e769c87c8d19 tempest-VolumesActionsTest-1003738196 None] Volume detach called, but volume not attached. Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:57:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e958cc19-f1e2-4a0e-a885-e769c87c8d19 tempest-VolumesActionsTest-1003738196 None] Lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:04 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_i5ws0zbf" returned: 1 in 0.819s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_i5ws0zbf' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[86236ee1-c063-4d05-8879-9ac7a7c70a3d]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Acquiring lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Acquiring lock "cinder-quobyte-16d4a624-1ebf-4bca-9450-efe341b90015" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:04 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD Sep 08 13:57:04 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Lock "cinder-quobyte-16d4a624-1ebf-4bca-9450-efe341b90015" acquired by "delete_volume" :: waited 0.050s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee21b86e-92f7-4bb5-8193-e1e9b5fcc01a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:04 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 Sep 08 13:57:04 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:04 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:05 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015" returned: 0 in 0.568s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:05 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD Sep 08 13:57:05 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:05 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015 Sep 08 13:57:05 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:05 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD" returned: 1 in 0.597s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] 807cd7fb-4517-40d9-a8ad-bdcfb4beec24 was raw, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:05 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16d4a624-1ebf-4bca-9450-efe341b90015" returned: 0 in 0.488s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:05 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 Sep 08 13:57:05 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Lock "cinder-quobyte-16d4a624-1ebf-4bca-9450-efe341b90015" released by "delete_volume" :: held 1.199s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Created reservations ['55c93b3b-64b2-4dc6-b9ee-57bde6ed306d', '78f8745b-709f-4627-bea5-8f0bbfb6fa87', '1da2d727-4fca-406e-8138-43273ae37e95', 'bfc1048f-1476-4321-ae83-48cede90f668'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:05 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:05 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:06 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.457s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:06 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Deleted volume successfully. Sep 08 13:57:06 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e837fe35-f832-4fba-af84-c83951bd43fa tempest-VolumesActionsTest-1003738196 None] Lock "cinder-16d4a624-1ebf-4bca-9450-efe341b90015-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503" returned: 0 in 0.806s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_807cd7fb-4517-40d9-a8ad-bdcfb4beec24_682yv5cqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:57:06 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:06 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 1G Sep 08 13:57:06 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:06 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 1G" returned: 0 in 0.419s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Downloaded image 807cd7fb-4517-40d9-a8ad-bdcfb4beec24 ((None, [{'url': 'file:///opt/stack/data/glance/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'metadata': {}}])) to volume 3d0a1ce2-a08a-4ee2-8d02-72554128c503 successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Temporary image 807cd7fb-4517-40d9-a8ad-bdcfb4beec24 for user e643859ae4094046afb389cbbbeb9322 is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Marking volume 3d0a1ce2-a08a-4ee2-8d02-72554128c503 as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Copying metadata from image 807cd7fb-4517-40d9-a8ad-bdcfb4beec24 to 3d0a1ce2-a08a-4ee2-8d02-72554128c503. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Creating volume glance metadata for volume 3d0a1ce2-a08a-4ee2-8d02-72554128c503 backed by image 807cd7fb-4517-40d9-a8ad-bdcfb4beec24 with: {'image_id': '807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '68c16257c4960eb3829ffa413af2f630', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e88125-0f75-46ae-940d-db524e224d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503', 'volume_size': 1, 'image_id': '807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '68c16257c4960eb3829ffa413af2f630', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '454f898c16f7400cbc4286e2ac270cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13f23be08cce5b59a3c68dcffbea17ce2ecdd12cdb296250c58ee8cebfbf7c981e5fcde9ceea5f76ad6243cfe09664f44f73067581b34283cf7950711ac3096e', 'id': '807cd7fb-4517-40d9-a8ad-bdcfb4beec24', 'created_at': datetime.datetime(2026, 9, 8, 11, 56, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 56, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/807cd7fb-4517-40d9-a8ad-bdcfb4beec24/file', 'properties': {}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f902f5-5e45-4b8d-9011-49ced4904d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:06 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Volume volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 (3d0a1ce2-a08a-4ee2-8d02-72554128c503): created successfully Sep 08 13:57:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f902f5-5e45-4b8d-9011-49ced4904d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Flow 'volume_create_manager' (723e6f08-9af4-40d4-a82a-925edc9c086b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:07 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6fc25a6b-50d3-44bb-8cdd-c97434c0a9ab tempest-VolumeImageDependencyTests-72906235 None] Created volume successfully. Sep 08 13:57:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Acquiring lock "cinder-3d0a1ce2-a08a-4ee2-8d02-72554128c503-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Lock "cinder-3d0a1ce2-a08a-4ee2-8d02-72554128c503-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Acquiring lock "cinder-quobyte-3d0a1ce2-a08a-4ee2-8d02-72554128c503" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Lock "cinder-quobyte-3d0a1ce2-a08a-4ee2-8d02-72554128c503" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:08 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b729e-c3ce-48f4-b8f9-0b2437f5d664]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:08 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 Sep 08 13:57:08 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:08 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503" returned: 0 in 0.508s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:08 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503 Sep 08 13:57:08 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:08 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3d0a1ce2-a08a-4ee2-8d02-72554128c503" returned: 0 in 0.318s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Lock "cinder-quobyte-3d0a1ce2-a08a-4ee2-8d02-72554128c503" released by "delete_volume" :: held 0.879s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:08 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Created reservations ['e5aba5ae-66b8-43ef-80da-0b35fe29054f', '4f2ace77-4f33-47aa-a4bc-788982f6c825', '10fcfc5e-5b3a-44c0-ae5b-369703918d14', '948bfd02-0493-4b0d-beac-b0819b005044'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:09 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:09 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:09 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.370s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:09 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Deleted volume successfully. Sep 08 13:57:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f265805e-eaff-4972-8952-5dbd5c12dbf8 tempest-VolumeImageDependencyTests-72906235 None] Lock "cinder-3d0a1ce2-a08a-4ee2-8d02-72554128c503-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (a452ebbb-bd15-4592-9cc4-e2a3b6f09255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4652e36d-bace-424a-a5dd-965caaa8680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4652e36d-bace-424a-a5dd-965caaa8680d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-586949982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efda35a-d667-4299-9671-a6638ddb8bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:14Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21cb71f-f37b-487b-b67a-18ec6137d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21cb71f-f37b-487b-b67a-18ec6137d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2575a9c3-00f5-4fa0-8a95-8c0d1329df67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2575a9c3-00f5-4fa0-8a95-8c0d1329df67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3efda35a-d667-4299-9671-a6638ddb8bb9', 'volume_name': 'volume-3efda35a-d667-4299-9671-a6638ddb8bb9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbad5ca-462d-4276-85eb-9c19d8fb44ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbad5ca-462d-4276-85eb-9c19d8fb44ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3d1b40-e640-468d-a383-1084506b3e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Volume 3efda35a-d667-4299-9671-a6638ddb8bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3efda35a-d667-4299-9671-a6638ddb8bb9', 'volume_size': 1} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-586949982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efda35a-d667-4299-9671-a6638ddb8bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:14Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Creating volume 3efda35a-d667-4299-9671-a6638ddb8bb9 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:14 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:14 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 1073741824 Sep 08 13:57:14 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Flow 'volume_create_manager' (142193c0-1d53-4b36-b668-748552738ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2dcbc5-5023-4181-ad26-834b7386c159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2dcbc5-5023-4181-ad26-834b7386c159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e99eef-a003-41ee-a84b-c53466c2b1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d30553bb374c208270fe119e0c0185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:15Z,use_quota=True,user_id='6df68dd33ff642c99545b53a847b1854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63046aa1-24d9-4cc8-8e03-d2989bc739cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63046aa1-24d9-4cc8-8e03-d2989bc739cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1412d599-3497-4f85-8270-8e0297a2faa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1412d599-3497-4f85-8270-8e0297a2faa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e99eef-a003-41ee-a84b-c53466c2b1e9', 'volume_name': 'volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a013c5-b1e0-46f0-9188-b82680e43cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a013c5-b1e0-46f0-9188-b82680e43cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ee75d-32ff-4c07-9aab-37ad12cda6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:14 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Volume e2e99eef-a003-41ee-a84b-c53466c2b1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9', 'volume_size': 1} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:14 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 1073741824" returned: 0 in 0.606s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:15 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 Sep 08 13:57:15 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:15 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e99eef-a003-41ee-a84b-c53466c2b1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d30553bb374c208270fe119e0c0185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:15Z,use_quota=True,user_id='6df68dd33ff642c99545b53a847b1854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Creating volume e2e99eef-a003-41ee-a84b-c53466c2b1e9 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:15 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3d1b40-e640-468d-a383-1084506b3e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3efda35a-d667-4299-9671-a6638ddb8bb9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5c67ab-f823-4def-be75-2fc066df4656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:15 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 1073741824 Sep 08 13:57:15 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:15 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Volume volume-3efda35a-d667-4299-9671-a6638ddb8bb9 (3efda35a-d667-4299-9671-a6638ddb8bb9): created successfully Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5c67ab-f823-4def-be75-2fc066df4656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (a452ebbb-bd15-4592-9cc4-e2a3b6f09255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a2fa119c-18d3-4652-be56-05e966dc0009 tempest-VolumesActionsTest-1003738196 None] Created volume successfully. Sep 08 13:57:15 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 1073741824" returned: 0 in 0.611s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:16 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 Sep 08 13:57:16 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:16 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9" returned: 0 in 0.307s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ee75d-32ff-4c07-9aab-37ad12cda6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2209ac48-91bf-4f9f-9584-d56c27872d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:16 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Volume volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 (e2e99eef-a003-41ee-a84b-c53466c2b1e9): created successfully Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2209ac48-91bf-4f9f-9584-d56c27872d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Flow 'volume_create_manager' (142193c0-1d53-4b36-b668-748552738ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:16 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-faa25465-7c86-48a1-a6fb-dfa37cf7a562 tempest-CinderUnicodeTest-248290258 None] Created volume successfully. Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-3efda35a-d667-4299-9671-a6638ddb8bb9-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Lock "cinder-3efda35a-d667-4299-9671-a6638ddb8bb9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-quobyte-3efda35a-d667-4299-9671-a6638ddb8bb9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Lock "cinder-quobyte-3efda35a-d667-4299-9671-a6638ddb8bb9" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a8f31f-ee86-4d05-807f-5e164ed81559]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:16 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 Sep 08 13:57:16 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:17 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9" returned: 0 in 0.615s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:17 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9 Sep 08 13:57:17 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Flow 'volume_create_manager' (224ab2a1-415f-448f-a452-1ae0955cffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bd7588-f25c-462c-bb06-26995c8cc297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bd7588-f25c-462c-bb06-26995c8cc297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-718159074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d30553bb374c208270fe119e0c0185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:18Z,use_quota=True,user_id='6df68dd33ff642c99545b53a847b1854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed28008a-5e82-4537-9eca-1aa472478666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed28008a-5e82-4537-9eca-1aa472478666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cc90f8-5c7e-4614-9674-b7adff0b7251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cc90f8-5c7e-4614-9674-b7adff0b7251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d', 'volume_name': 'volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:17 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a94823e-0dac-4892-bc09-b936b0925054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a94823e-0dac-4892-bc09-b936b0925054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d482e3-07ac-4bf9-b414-57859c74a8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:17 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Volume 90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d', 'volume_size': 1} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-718159074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d30553bb374c208270fe119e0c0185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:18Z,use_quota=True,user_id='6df68dd33ff642c99545b53a847b1854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Creating volume 90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:17 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3efda35a-d667-4299-9671-a6638ddb8bb9" returned: 0 in 0.504s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:17 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d 1073741824 Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Lock "cinder-quobyte-3efda35a-d667-4299-9671-a6638ddb8bb9" released by "delete_volume" :: held 1.186s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:17 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Created reservations ['fec78be2-8ed2-4441-b4a8-7ede72a3e665', 'd61d5ca6-b538-4c83-bfae-1d2e2be873f5', 'f82acaf3-2dd6-4a47-9f80-abfd828b5bd5', 'b6c4346d-931a-4999-96ab-269e3265620f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:17 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:17 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:18 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.313s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Deleted volume successfully. Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-21f6f972-7776-4833-a2a9-f5968cac02aa tempest-VolumesActionsTest-1577562661 None] Lock "cinder-3efda35a-d667-4299-9671-a6638ddb8bb9-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:18 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d 1073741824" returned: 0 in 0.595s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:18 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d Sep 08 13:57:18 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:18 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" returned: 0 in 0.312s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d482e3-07ac-4bf9-b414-57859c74a8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f91cca-7086-4433-8031-e6cd99b6f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:18 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Volume volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d (90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d): created successfully Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f91cca-7086-4433-8031-e6cd99b6f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Flow 'volume_create_manager' (224ab2a1-415f-448f-a452-1ae0955cffbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-369869c8-2705-475d-8f2d-e045880fe2be tempest-CinderUnicodeTest-248290258 None] Created volume successfully. Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (d227269f-2c7a-4596-8ffc-58ebd7fd0a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1206fe35-4c34-417b-a5be-d09d46bc5613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1206fe35-4c34-417b-a5be-d09d46bc5613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796461872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:19Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f800fa9-20cb-4e37-a07d-abe3fa186475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f800fa9-20cb-4e37-a07d-abe3fa186475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7cee72-3ca2-4e23-9b1a-73a1e0c0db02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7cee72-3ca2-4e23-9b1a-73a1e0c0db02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9', 'volume_name': 'volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc1f48f-8a28-4dcb-936a-c142a4bb43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc1f48f-8a28-4dcb-936a-c142a4bb43bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3677735b-3950-4fa0-9bff-ff41b1c6c607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Volume ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9', 'volume_size': 1} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796461872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:19Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Creating volume ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:19 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:19 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 1073741824 Sep 08 13:57:19 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:20 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 1073741824" returned: 0 in 0.802s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:20 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 Sep 08 13:57:20 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:20 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9" returned: 0 in 0.325s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.399s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3677735b-3950-4fa0-9bff-ff41b1c6c607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175d2d8c-8507-4380-8cd4-4d1769f89bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Creating offline snapshot 770217fd-fc82-418a-b627-9d34ee8bdc9f of volume 90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:57:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Volume volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 (ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9): created successfully Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175d2d8c-8507-4380-8cd4-4d1769f89bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (d227269f-2c7a-4596-8ffc-58ebd7fd0a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf452f3-5279-439e-9557-bd9dbc5fe152]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9bd5a542-cbc6-4c2b-98ea-2cdfb50cd824 tempest-VolumesActionsTest-1003738196 None] Created volume successfully. Sep 08 13:57:21 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d Sep 08 13:57:21 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:21 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" returned: 0 in 0.428s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:21 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f 1G Sep 08 13:57:21 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-quobyte-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-quobyte-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b909ff-ed29-4c5d-be84-542e5df321ba]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:21 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f 1G" returned: 0 in 0.641s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:22 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f Sep 08 13:57:22 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:22 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 Sep 08 13:57:22 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:22 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9" returned: 0 in 0.489s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:22 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f" returned: 0 in 0.479s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:22 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f is being set with open permissions: ugo+rw Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:22 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9 Sep 08 13:57:22 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:22 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f Sep 08 13:57:22 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:22 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f" returned: 0 in 0.310s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:22 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9" returned: 0 in 0.368s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-quobyte-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9" released by "delete_volume" :: held 0.948s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:22 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.info Sep 08 13:57:22 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Created reservations ['8d3833be-1413-45aa-86bd-92afb554b123', '5baccce2-fc07-430a-8feb-5a8a4098d345', 'c4d59944-2bd1-4420-b3e6-1f8133792ec6', '6c7e7067-5761-42ac-9d9d-b4a9547ac0e2'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:23 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:23 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:23 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.info" returned: 0 in 0.320s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:23 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.info is being set with open permissions: ugo+rw Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:23 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.info Sep 08 13:57:23 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:23 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Deleted volume successfully. Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-6c780177-fcd5-42d2-93c6-4d1216328491 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-ad08fdbc-78ff-40e8-a0d7-c94f9093f5d9-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:23 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.info" returned: 0 in 0.412s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-edba9372-7281-45d1-95a6-b6e86221b7c3 tempest-CinderUnicodeTest-248290258 None] Create snapshot completed successfully Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "cinder-770217fd-fc82-418a-b627-9d34ee8bdc9f-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-770217fd-fc82-418a-b627-9d34ee8bdc9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "cinder-quobyte-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-quobyte-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "cinder-quobyte-770217fd-fc82-418a-b627-9d34ee8bdc9f" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-quobyte-770217fd-fc82-418a-b627-9d34ee8bdc9f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Deleting offline snapshot 770217fd-fc82-418a-b627-9d34ee8bdc9f of volume 90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] snapshot_file for this snap is: volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be4cfb6-c987-48dc-a2a3-76c4c6c15ec0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (9c44be54-f571-408e-828a-48397de7da0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e277cc0-ed29-4283-8387-d65deb1e2dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e277cc0-ed29-4283-8387-d65deb1e2dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2084986913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae89c589-ffb3-464a-945a-303b341c16dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:25Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa56128-0e8e-4068-ba2d-4a76138fa769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa56128-0e8e-4068-ba2d-4a76138fa769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1295ca4-a181-4236-8847-e8d799cd8787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1295ca4-a181-4236-8847-e8d799cd8787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae89c589-ffb3-464a-945a-303b341c16dc', 'volume_name': 'volume-ae89c589-ffb3-464a-945a-303b341c16dc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91dd14a-bd15-4d44-9870-360c4aea8b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91dd14a-bd15-4d44-9870-360c4aea8b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af0350c-91d7-42ec-a28d-40ccc4389d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Volume ae89c589-ffb3-464a-945a-303b341c16dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae89c589-ffb3-464a-945a-303b341c16dc', 'volume_size': 1} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2084986913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae89c589-ffb3-464a-945a-303b341c16dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:25Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:24 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Creating volume ae89c589-ffb3-464a-945a-303b341c16dc {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:24 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:24 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:25 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc 1073741824 Sep 08 13:57:25 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:25 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f" returned: 0 in 0.407s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[757e766c-e58b-4e7f-86e1-f9446c2540c0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:25 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d Sep 08 13:57:25 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:25 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc 1073741824" returned: 0 in 0.622s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:25 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc Sep 08 13:57:25 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:25 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" returned: 0 in 0.467s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:25 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f Sep 08 13:57:25 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:25 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc" returned: 0 in 0.283s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af0350c-91d7-42ec-a28d-40ccc4389d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae89c589-ffb3-464a-945a-303b341c16dc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10eb05e7-e8df-4fba-9f5e-015e9dd2f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Volume volume-ae89c589-ffb3-464a-945a-303b341c16dc (ae89c589-ffb3-464a-945a-303b341c16dc): created successfully Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10eb05e7-e8df-4fba-9f5e-015e9dd2f031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (9c44be54-f571-408e-828a-48397de7da0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c0c5646b-5c7e-417a-b3b0-a742aebc5f41 tempest-VolumesActionsTest-1003738196 None] Created volume successfully. Sep 08 13:57:26 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f" returned: 0 in 0.487s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:26 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f Sep 08 13:57:26 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:26 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d.770217fd-fc82-418a-b627-9d34ee8bdc9f" returned: 0 in 0.275s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-quobyte-770217fd-fc82-418a-b627-9d34ee8bdc9f" released by "_delete_snapshot" :: held 1.780s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-quobyte-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" released by "delete_snapshot" :: held 1.820s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Created reservations ['77d23706-7fa6-498e-9470-505a748060f2', 'ed0f977b-8177-4307-8b7d-791cd61c5c40', 'ad0e2ddc-0c07-4e46-a61d-e1e517a9f7be', '2df241f3-8055-432b-a9a5-d2f5eaa40327'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Delete snapshot completed successfully. Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2779f102-443d-47db-96eb-d6eefffa43f2 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-770217fd-fc82-418a-b627-9d34ee8bdc9f-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "cinder-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "cinder-quobyte-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-quobyte-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1ab37b-5363-479d-919c-4c238d5d71d2]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-ae89c589-ffb3-464a-945a-303b341c16dc-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-ae89c589-ffb3-464a-945a-303b341c16dc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-quobyte-ae89c589-ffb3-464a-945a-303b341c16dc" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-quobyte-ae89c589-ffb3-464a-945a-303b341c16dc" acquired by "delete_volume" :: waited 0.038s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:27 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d Sep 08 13:57:27 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4f1d92-763f-4cf1-9e67-280893d06721]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:27 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc Sep 08 13:57:27 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:27 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" returned: 0 in 0.562s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:27 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d Sep 08 13:57:27 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:27 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc" returned: 0 in 0.531s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:27 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc Sep 08 13:57:27 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:28 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-quobyte-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d" released by "delete_volume" :: held 1.016s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Created reservations ['69575d3a-4bff-4f84-b0ed-05b38e033fe2', '26466e76-5a22-4716-aaab-c3b9282892b2', '599a9fd1-8580-40f0-8a1d-8c5406eb293d', '027fe21e-bdda-4721-9ebe-1cdd575fa069'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:28 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ae89c589-ffb3-464a-945a-303b341c16dc" returned: 0 in 0.357s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-quobyte-ae89c589-ffb3-464a-945a-303b341c16dc" released by "delete_volume" :: held 0.953s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:28 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:28 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Created reservations ['0b45784c-9eab-4a51-bc9b-afecf861f536', '71d0b986-9ff9-4105-909b-823bbe28eac6', '59560414-e0f4-4abc-9fd8-14226345b244', 'fae471cc-4617-4fdf-8091-e74c4408910f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:28 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:28 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:28 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.340s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Deleted volume successfully. Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d86042c4-8285-4c88-a3fd-21cda1146c76 tempest-CinderUnicodeTest-248290258 None] Lock "cinder-90bd8a1d-e9cb-4ce7-bdca-71c1aa681b8d-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:28 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.308s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Deleted volume successfully. Sep 08 13:57:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0ba89109-0621-4382-86d0-cfa0b3ed15e6 tempest-VolumesActionsTest-1577562661 None] Lock "cinder-ae89c589-ffb3-464a-945a-303b341c16dc-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Acquiring lock "cinder-e2e99eef-a003-41ee-a84b-c53466c2b1e9-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Lock "cinder-e2e99eef-a003-41ee-a84b-c53466c2b1e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Acquiring lock "cinder-quobyte-e2e99eef-a003-41ee-a84b-c53466c2b1e9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Lock "cinder-quobyte-e2e99eef-a003-41ee-a84b-c53466c2b1e9" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:29 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bf555a-4e04-4206-831c-6bb8126e2757]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:29 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 Sep 08 13:57:29 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:30 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9" returned: 0 in 0.520s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:30 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9 Sep 08 13:57:30 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (908331f1-9054-42da-93cc-fbeac92cc642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac21331-016c-44c3-88a8-8ff45f436df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac21331-016c-44c3-88a8-8ff45f436df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562155504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74611953-f4c4-4283-894f-a3ae8a03007a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:30Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470f84c4-5f1d-42c2-883f-11969f3c7768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470f84c4-5f1d-42c2-883f-11969f3c7768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bce7ec-e72f-4379-aa11-04b8a55df51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bce7ec-e72f-4379-aa11-04b8a55df51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74611953-f4c4-4283-894f-a3ae8a03007a', 'volume_name': 'volume-74611953-f4c4-4283-894f-a3ae8a03007a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eea693f-3f41-4a92-9ea8-1d3be3ddea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:30 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eea693f-3f41-4a92-9ea8-1d3be3ddea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e611c2-51b3-4d42-b0ce-845470f28068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:30 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Volume 74611953-f4c4-4283-894f-a3ae8a03007a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74611953-f4c4-4283-894f-a3ae8a03007a', 'volume_size': 1} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562155504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74611953-f4c4-4283-894f-a3ae8a03007a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:30Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Creating volume 74611953-f4c4-4283-894f-a3ae8a03007a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:30 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e2e99eef-a003-41ee-a84b-c53466c2b1e9" returned: 0 in 0.419s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:30 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a 1073741824 Sep 08 13:57:30 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Lock "cinder-quobyte-e2e99eef-a003-41ee-a84b-c53466c2b1e9" released by "delete_volume" :: held 1.020s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Created reservations ['377ac4b9-a61b-48ad-8d68-3d6edcc609be', '41c46a7f-1782-4258-9766-8f7055c1a49b', 'b5987624-c215-4580-af43-726b36670a9b', '3a50efbc-242d-4fc8-afbe-c1d7b4836729'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:30 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:30 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:31 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a 1073741824" returned: 0 in 0.610s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:31 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.408s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Deleted volume successfully. Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4f8871f-c283-4a98-85c6-3dc5ad8661af tempest-CinderUnicodeTest-248290258 None] Lock "cinder-e2e99eef-a003-41ee-a84b-c53466c2b1e9-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:31 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a Sep 08 13:57:31 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:31 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a" returned: 0 in 0.342s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e611c2-51b3-4d42-b0ce-845470f28068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74611953-f4c4-4283-894f-a3ae8a03007a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171f49da-037e-4a4d-9b58-e7e18ad751ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:31 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Volume volume-74611953-f4c4-4283-894f-a3ae8a03007a (74611953-f4c4-4283-894f-a3ae8a03007a): created successfully Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171f49da-037e-4a4d-9b58-e7e18ad751ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (908331f1-9054-42da-93cc-fbeac92cc642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8c5434be-3de9-4302-b4a9-a9f95a2e273f tempest-VolumesActionsTest-1003738196 None] Created volume successfully. Sep 08 13:57:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-74611953-f4c4-4283-894f-a3ae8a03007a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Lock "cinder-74611953-f4c4-4283-894f-a3ae8a03007a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Acquiring lock "cinder-quobyte-74611953-f4c4-4283-894f-a3ae8a03007a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Lock "cinder-quobyte-74611953-f4c4-4283-894f-a3ae8a03007a" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:32 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e5fa72-3433-48fc-add8-dcbe8a41a1c3]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:32 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a Sep 08 13:57:32 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:33 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a" returned: 0 in 0.463s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:33 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a Sep 08 13:57:33 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:33 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-74611953-f4c4-4283-894f-a3ae8a03007a" returned: 0 in 0.310s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Lock "cinder-quobyte-74611953-f4c4-4283-894f-a3ae8a03007a" released by "delete_volume" :: held 0.828s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Created reservations ['127ec975-a8e7-4bc5-ac91-14f6ecd35950', '2f6922e6-53e0-42d0-ad74-6c19164c3747', '6959abaa-c1cb-492b-82b4-ad505ba6966a', 'ad6f2d96-9db3-4a5b-b2c0-712bb7688dea'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:33 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:33 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:34 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.357s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Deleted volume successfully. Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c468e2aa-3ed0-4027-8e73-f0d626ebedad tempest-VolumesActionsTest-1577562661 None] Lock "cinder-74611953-f4c4-4283-894f-a3ae8a03007a-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (38645a0e-a070-4c77-9588-a29b15cc9d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85912725-0b33-450f-9e06-eaa81c49aeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85912725-0b33-450f-9e06-eaa81c49aeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1823735871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f3f24c-54ab-41fd-885d-ddd9fdeb99e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:35Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e199d9-a016-4fb8-b834-8d4c8d75473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e199d9-a016-4fb8-b834-8d4c8d75473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2e1954-ff43-482a-a8e2-9894ea77cef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2e1954-ff43-482a-a8e2-9894ea77cef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f3f24c-54ab-41fd-885d-ddd9fdeb99e4', 'volume_name': 'volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d732ebc6-1443-4bea-9e03-9ebe7f4a3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d732ebc6-1443-4bea-9e03-9ebe7f4a3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5047104c-7cfd-4007-91b9-e19c00a85bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:34 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Volume 07f3f24c-54ab-41fd-885d-ddd9fdeb99e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4', 'volume_size': 1} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1823735871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f3f24c-54ab-41fd-885d-ddd9fdeb99e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0671c464e2af4d24826505725bdcdb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:35Z,use_quota=True,user_id='43a0c883dd7849f2a6d80d38cbc002c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Creating volume 07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:34 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:34 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 1073741824 Sep 08 13:57:34 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:35 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 1073741824" returned: 0 in 0.728s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:35 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 Sep 08 13:57:35 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:36 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4" returned: 0 in 0.441s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5047104c-7cfd-4007-91b9-e19c00a85bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77920477-f28e-4a60-bf78-0ece2a9c66f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:36 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Volume volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 (07f3f24c-54ab-41fd-885d-ddd9fdeb99e4): created successfully Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77920477-f28e-4a60-bf78-0ece2a9c66f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Flow 'volume_create_manager' (38645a0e-a070-4c77-9588-a29b15cc9d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1511761b-3899-40a8-b71c-09d6cc38b1b8 tempest-VolumesActionsTest-1003738196 None] Created volume successfully. Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Flow 'volume_create_manager' (75e64ff6-10fa-423b-910b-6e6737c5c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac14fe1-c21b-4623-8793-3f2554b84537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac14fe1-c21b-4623-8793-3f2554b84537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-611542368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f13a2d-9847-452f-9598-a96546e539dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849ac76daea04a68b7168c457a09d1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:37Z,use_quota=True,user_id='423f01a4e55c4a2cade4d3ea69529011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee044bb7-383e-48e6-a50a-952819f85070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee044bb7-383e-48e6-a50a-952819f85070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212481b0-fa55-4880-8527-8d44ee49d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:36 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 13:57:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212481b0-fa55-4880-8527-8d44ee49d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54f13a2d-9847-452f-9598-a96546e539dc', 'volume_name': 'volume-54f13a2d-9847-452f-9598-a96546e539dc', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9f8e7a-93ad-422f-8e5e-a71cbffa18f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9f8e7a-93ad-422f-8e5e-a71cbffa18f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a995ec7-dec2-4ef5-a090-0c16da0dfd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:37 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Volume 54f13a2d-9847-452f-9598-a96546e539dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54f13a2d-9847-452f-9598-a96546e539dc', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 13:57:37 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Trying to clone 54f13a2d-9847-452f-9598-a96546e539dc from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f at location (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 13:57:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "cinder-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Lock "cinder-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 13:57:38 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Image download 20.69 MB at 20.69 MB/s Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "cinder-quobyte-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Lock "cinder-quobyte-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b5d91-3181-43e6-8959-8e5fe5ad2b24]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd781804-abac-42c6-bb35-1934cb1b87b3]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:38 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 Sep 08 13:57:38 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:38 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD Sep 08 13:57:38 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:38 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4" returned: 0 in 0.675s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:38 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4 Sep 08 13:57:38 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:38 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:38 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f is fetched for user 423f01a4e55c4a2cade4d3ea69529011. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6455da59-72b1-4070-b866-e65662d2ca08]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:39 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4" returned: 0 in 0.530s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Lock "cinder-quobyte-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4" released by "delete_volume" :: held 1.307s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:39 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD Sep 08 13:57:39 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Created reservations ['c23fb3c7-603f-4cce-92e9-5938adc86fe6', '56b0dd88-2cdf-44db-b73e-8eb22085887a', '1ac73671-667e-4b8b-b838-1227070c6f6d', '115bf42e-0f48-4f5c-a9a2-6b29658932a5'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:39 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:57:39 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:39 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-611542368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f13a2d-9847-452f-9598-a96546e539dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849ac76daea04a68b7168c457a09d1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:37Z,use_quota=True,user_id='423f01a4e55c4a2cade4d3ea69529011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Creating volume 54f13a2d-9847-452f-9598-a96546e539dc {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:39 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:39 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc 1073741824 Sep 08 13:57:39 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:40 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.452s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:40 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:57:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Deleted volume successfully. Sep 08 13:57:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cd072d3d-e26b-458a-a4b8-7df1eee4e0b2 tempest-VolumesActionsTest-1003738196 None] Lock "cinder-07f3f24c-54ab-41fd-885d-ddd9fdeb99e4-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:57:40 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc 1073741824" returned: 0 in 0.723s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:40 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc Sep 08 13:57:40 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:41 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc" returned: 0 in 0.378s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:41 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Attempting download of 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume 54f13a2d-9847-452f-9598-a96546e539dc. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 13:57:41 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ec6746-1a06-41d5-96a8-4f9409fef174]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_c1539hs7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:41 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_c1539hs7 Sep 08 13:57:41 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:41 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_c1539hs7" returned: 0 in 0.518s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_c1539hs7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:41 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_c1539hs7 Sep 08 13:57:41 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:42 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_c1539hs7" returned: 1 in 0.382s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_c1539hs7' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:57:42 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6522fc-61a3-4f32-996a-de2429f55af6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:57:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:42 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD Sep 08 13:57:42 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:42 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:42 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f was qcow2, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 13:57:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:42 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc Sep 08 13:57:42 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:44 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc" returned: 0 in 2.465s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:44 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_o7l6xzczdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:57:44 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Converted 112.00 MB image at 45.41 MB/s Sep 08 13:57:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:45 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc 1G Sep 08 13:57:45 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:45 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc 1G" returned: 0 in 0.587s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Downloaded image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume 54f13a2d-9847-452f-9598-a96546e539dc successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f for user 423f01a4e55c4a2cade4d3ea69529011 is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Marking volume 54f13a2d-9847-452f-9598-a96546e539dc as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Copying metadata from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f to 54f13a2d-9847-452f-9598-a96546e539dc. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Creating volume glance metadata for volume 54f13a2d-9847-452f-9598-a96546e539dc backed by image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a995ec7-dec2-4ef5-a090-0c16da0dfd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f13a2d-9847-452f-9598-a96546e539dc', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc082dbf-d1aa-40f9-998c-12c6fc64b0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:45 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Volume volume-54f13a2d-9847-452f-9598-a96546e539dc (54f13a2d-9847-452f-9598-a96546e539dc): created successfully Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc082dbf-d1aa-40f9-998c-12c6fc64b0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Flow 'volume_create_manager' (75e64ff6-10fa-423b-910b-6e6737c5c262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-252c9ffd-ef18-4483-82eb-a2db66d7c4b6 tempest-TestShelveInstance-169706403 None] Created volume successfully. Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Flow 'volume_create_manager' (2486879d-6a91-470e-8622-5671162b3afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a5ed20-3ebe-43c5-8b22-5d3124f86771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a5ed20-3ebe-43c5-8b22-5d3124f86771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2047057377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8b0cba-956f-489a-863b-09d30fcf7ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da39010761514b17b63b7b69bba6c486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:49Z,use_quota=True,user_id='01641f12463e4549b0c9c724b29838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79bd464-b25c-4b54-a36d-2ec47f5d8193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79bd464-b25c-4b54-a36d-2ec47f5d8193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cab9062-2005-41f2-ac32-ec0905699a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cab9062-2005-41f2-ac32-ec0905699a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8b0cba-956f-489a-863b-09d30fcf7ef4', 'volume_name': 'volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738a39a8-d8ec-4880-993f-900badf70ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738a39a8-d8ec-4880-993f-900badf70ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc7177e-79dd-40dd-a64d-8bfd01e1d84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:48 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Volume 3f8b0cba-956f-489a-863b-09d30fcf7ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4', 'volume_size': 1} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2047057377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8b0cba-956f-489a-863b-09d30fcf7ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da39010761514b17b63b7b69bba6c486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:57:49Z,use_quota=True,user_id='01641f12463e4549b0c9c724b29838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Creating volume 3f8b0cba-956f-489a-863b-09d30fcf7ef4 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:57:48 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:57:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:48 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 1073741824 Sep 08 13:57:48 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:49 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 1073741824" returned: 0 in 0.790s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:57:49 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 Sep 08 13:57:49 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:57:50 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4" returned: 0 in 0.373s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc7177e-79dd-40dd-a64d-8bfd01e1d84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385f9bd0-c885-42e7-b091-fae1701ca2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:57:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Volume volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 (3f8b0cba-956f-489a-863b-09d30fcf7ef4): created successfully Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385f9bd0-c885-42e7-b091-fae1701ca2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Flow 'volume_create_manager' (2486879d-6a91-470e-8622-5671162b3afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:57:50 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-18458e20-04ec-452c-bd4a-9ff1e57e5ff6 tempest-TestMinimumBasicScenario-1698418390 None] Created volume successfully. Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-4f80714d-c8e6-4e0e-aff3-1bd41f08d10c req-431c3f4c-3a76-4023-9fad-988362b60e9c tempest-TestShelveInstance-169706403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-4f80714d-c8e6-4e0e-aff3-1bd41f08d10c req-431c3f4c-3a76-4023-9fad-988362b60e9c tempest-TestShelveInstance-169706403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-4f80714d-c8e6-4e0e-aff3-1bd41f08d10c req-431c3f4c-3a76-4023-9fad-988362b60e9c tempest-TestShelveInstance-169706403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-4f80714d-c8e6-4e0e-aff3-1bd41f08d10c req-431c3f4c-3a76-4023-9fad-988362b60e9c tempest-TestShelveInstance-169706403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-54f13a2d-9847-452f-9598-a96546e539dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14d70a98-82a9-4682-be7d-8e7c78e90ecd', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:57:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-4f80714d-c8e6-4e0e-aff3-1bd41f08d10c req-431c3f4c-3a76-4023-9fad-988362b60e9c tempest-TestShelveInstance-169706403 None] attachment_update completed successfully. Sep 08 13:57:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-540c1933-5a1b-4e0e-a136-8f22f8eeb0ca req-06d98a65-9339-4fcf-ba7b-41870bb6c1d4 tempest-TestMinimumBasicScenario-1698418390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:57:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-540c1933-5a1b-4e0e-a136-8f22f8eeb0ca req-06d98a65-9339-4fcf-ba7b-41870bb6c1d4 tempest-TestMinimumBasicScenario-1698418390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:57:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-540c1933-5a1b-4e0e-a136-8f22f8eeb0ca req-06d98a65-9339-4fcf-ba7b-41870bb6c1d4 tempest-TestMinimumBasicScenario-1698418390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:57:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-540c1933-5a1b-4e0e-a136-8f22f8eeb0ca req-06d98a65-9339-4fcf-ba7b-41870bb6c1d4 tempest-TestMinimumBasicScenario-1698418390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '789233a0-92ba-4bdb-a277-1b800fee8453', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:57:52 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-540c1933-5a1b-4e0e-a136-8f22f8eeb0ca req-06d98a65-9339-4fcf-ba7b-41870bb6c1d4 tempest-TestMinimumBasicScenario-1698418390 None] attachment_update completed successfully. Sep 08 13:58:02 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=110,cinder:INSERT=41,cinder:UPDATE=119,cinder:DELETE=7 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:58:02 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=125,cinder:SELECT=110,cinder:INSERT=35,cinder:DELETE=14 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:03 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:58:03 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:03 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.432s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:58:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:58:06 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:58:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Flow 'volume_create_manager' (1500a1c5-d043-4bac-9bd5-91e45a6cd720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a3843c-1b3e-46b5-8b45-43ebbcbecebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a3843c-1b3e-46b5-8b45-43ebbcbecebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-816068879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2267bfa1-7ae1-4d21-8814-d85c0561c407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac73a442935649f7bd85def9eead3b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:07Z,use_quota=True,user_id='76a317bf765644ca81c4c1af0af95a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5416729-38fd-494b-9c12-1cb5f86d13f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5416729-38fd-494b-9c12-1cb5f86d13f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8b95c0-5e2c-46ed-a364-1163539ee612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:06 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 13:58:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8b95c0-5e2c-46ed-a364-1163539ee612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2267bfa1-7ae1-4d21-8814-d85c0561c407', 'volume_name': 'volume-2267bfa1-7ae1-4d21-8814-d85c0561c407', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7d7aba-b0ec-49a6-97a3-88f8a7a49f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7d7aba-b0ec-49a6-97a3-88f8a7a49f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5b6a79-edae-4266-99f5-b3c1212bf2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:07 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Volume 2267bfa1-7ae1-4d21-8814-d85c0561c407: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2267bfa1-7ae1-4d21-8814-d85c0561c407', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 13:58:07 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Trying to clone 2267bfa1-7ae1-4d21-8814-d85c0561c407 from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f at location (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 13:58:07 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 13:58:07 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Image download 20.69 MB at 20.69 MB/s Sep 08 13:58:07 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b4efdc-ff4d-4e7d-9ecc-22c9715530b6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:07 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD Sep 08 13:58:07 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:07 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f is fetched for user 76a317bf765644ca81c4c1af0af95a94. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd27c04-973d-4689-aea0-920d1a8e468f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:08 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD Sep 08 13:58:08 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:08 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-816068879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2267bfa1-7ae1-4d21-8814-d85c0561c407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac73a442935649f7bd85def9eead3b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:07Z,use_quota=True,user_id='76a317bf765644ca81c4c1af0af95a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Creating volume 2267bfa1-7ae1-4d21-8814-d85c0561c407 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:58:08 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:08 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 1073741824 Sep 08 13:58:08 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:08 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 1073741824" returned: 0 in 0.450s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:08 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 Sep 08 13:58:08 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:09 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Attempting download of 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume 2267bfa1-7ae1-4d21-8814-d85c0561c407. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa42376-9709-4bc8-ac56-3249f455becb]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_pputefwb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:09 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_pputefwb Sep 08 13:58:09 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:09 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_pputefwb" returned: 0 in 0.331s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_pputefwb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:09 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_pputefwb Sep 08 13:58:09 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:09 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_pputefwb" returned: 1 in 0.337s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f_pputefwb' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f971f98-50cc-408a-b0d9-4a03a1531cbe]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:10 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD Sep 08 13:58:10 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:10 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:10 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f was qcow2, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 13:58:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:10 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 Sep 08 13:58:10 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:12 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407" returned: 0 in 1.907s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f__ejldj_tdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:58:12 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Converted 112.00 MB image at 58.70 MB/s Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:12 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 1G Sep 08 13:58:12 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:12 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 1G" returned: 0 in 0.356s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Downloaded image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f ((None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}])) to volume 2267bfa1-7ae1-4d21-8814-d85c0561c407 successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Temporary image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f for user 76a317bf765644ca81c4c1af0af95a94 is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Marking volume 2267bfa1-7ae1-4d21-8814-d85c0561c407 as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Copying metadata from image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f to 2267bfa1-7ae1-4d21-8814-d85c0561c407. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Creating volume glance metadata for volume 2267bfa1-7ae1-4d21-8814-d85c0561c407 backed by image 32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5b6a79-edae-4266-99f5-b3c1212bf2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2267bfa1-7ae1-4d21-8814-d85c0561c407', 'volume_size': 1, 'image_id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c8fbeff5dc43ba94b89f3e89287c7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f', 'created_at': datetime.datetime(2026, 9, 8, 11, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32c3dd5d-4f6f-4786-a6ca-139f2bd7d80f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0050eb1d-be3d-4014-9afc-ad3d4a00d9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Volume volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 (2267bfa1-7ae1-4d21-8814-d85c0561c407): created successfully Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0050eb1d-be3d-4014-9afc-ad3d4a00d9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Flow 'volume_create_manager' (1500a1c5-d043-4bac-9bd5-91e45a6cd720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:12 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-16b04606-953d-4149-83c2-3d8ad34cc363 tempest-VolumesImageMetadata-867976738 None] Created volume successfully. Sep 08 13:58:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Acquiring lock "cinder-2267bfa1-7ae1-4d21-8814-d85c0561c407-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Lock "cinder-2267bfa1-7ae1-4d21-8814-d85c0561c407-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Acquiring lock "cinder-quobyte-2267bfa1-7ae1-4d21-8814-d85c0561c407" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Lock "cinder-quobyte-2267bfa1-7ae1-4d21-8814-d85c0561c407" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:13 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[186cf43f-efbf-44cd-bd00-89f7403646d5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:13 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 Sep 08 13:58:13 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:14 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407" returned: 0 in 0.388s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:14 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407 Sep 08 13:58:14 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:14 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2267bfa1-7ae1-4d21-8814-d85c0561c407" returned: 0 in 0.264s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Lock "cinder-quobyte-2267bfa1-7ae1-4d21-8814-d85c0561c407" released by "delete_volume" :: held 0.692s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Created reservations ['a64b0a39-0d77-4a49-9347-274ca113fb49', '7961439e-352f-4075-a56c-02b22f947dc8', 'e55fb6bb-5535-4538-bd0e-8323ddc8820c', '1408bae8-c0db-4bb4-8ca1-0ea53313a410'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:14 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:58:14 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:14 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:58:14 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Deleted volume successfully. Sep 08 13:58:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9801fd2e-7843-4e8e-84d8-b1ce1566e98f tempest-VolumesImageMetadata-867976738 None] Lock "cinder-2267bfa1-7ae1-4d21-8814-d85c0561c407-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Flow 'volume_create_manager' (fe513325-8ced-4f5e-812d-a68b43823fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2a1571-ac78-4321-a31e-350061fb6a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2a1571-ac78-4321-a31e-350061fb6a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1008130545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2657dbc7-f59c-4c3e-89b7-18f1c392dda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6cca8539814faab8e0663b87677015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:19Z,use_quota=True,user_id='1ebd9506a47248079f5f08d2f0a212c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99aa976f-a8c0-4366-8461-59b6cd8686f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99aa976f-a8c0-4366-8461-59b6cd8686f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f972d1-0db0-421a-8e19-d6606a6e0f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f972d1-0db0-421a-8e19-d6606a6e0f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2657dbc7-f59c-4c3e-89b7-18f1c392dda6', 'volume_name': 'volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ba9125-fa2a-45b0-9a17-f0f4ac0d2c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ba9125-fa2a-45b0-9a17-f0f4ac0d2c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf5d31f-5217-44dd-8ec7-f24e0c722a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:18 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Volume 2657dbc7-f59c-4c3e-89b7-18f1c392dda6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6', 'volume_size': 1} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1008130545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2657dbc7-f59c-4c3e-89b7-18f1c392dda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6cca8539814faab8e0663b87677015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:19Z,use_quota=True,user_id='1ebd9506a47248079f5f08d2f0a212c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Creating volume 2657dbc7-f59c-4c3e-89b7-18f1c392dda6 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:58:18 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:58:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:18 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 1073741824 Sep 08 13:58:18 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:19 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 1073741824" returned: 0 in 0.530s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:19 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 Sep 08 13:58:19 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:19 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" returned: 0 in 0.329s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf5d31f-5217-44dd-8ec7-f24e0c722a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9004c2-0b3e-4558-a193-3103c509b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Volume volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 (2657dbc7-f59c-4c3e-89b7-18f1c392dda6): created successfully Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9004c2-0b3e-4558-a193-3103c509b960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Flow 'volume_create_manager' (fe513325-8ced-4f5e-812d-a68b43823fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c8ca1168-b2c3-4cd4-95fe-cbe20e047e4d tempest-SnapshotMetadataTestJSON-1204326859 None] Created volume successfully. Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Creating offline snapshot c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb of volume 2657dbc7-f59c-4c3e-89b7-18f1c392dda6 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b25013-c294-4144-b647-dd014be9f4cc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:21 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 Sep 08 13:58:21 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:21 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" returned: 0 in 0.377s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:21 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb 1G Sep 08 13:58:21 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:21 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb 1G" returned: 0 in 0.390s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:21 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb Sep 08 13:58:21 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:22 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb" returned: 0 in 0.321s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:22 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb is being set with open permissions: ugo+rw Sep 08 13:58:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:22 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb Sep 08 13:58:22 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:22 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb" returned: 0 in 0.256s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:22 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.info Sep 08 13:58:22 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:22 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.info" returned: 0 in 0.329s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:22 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.info is being set with open permissions: ugo+rw Sep 08 13:58:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:22 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.info Sep 08 13:58:22 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:23 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.info" returned: 0 in 0.280s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-29ea21f2-93ad-4f8e-896d-40ed3466aaa3 tempest-SnapshotMetadataTestJSON-1204326859 None] Create snapshot completed successfully Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "cinder-c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "cinder-quobyte-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-quobyte-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "cinder-quobyte-c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-quobyte-c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Deleting offline snapshot c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb of volume 2657dbc7-f59c-4c3e-89b7-18f1c392dda6 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] snapshot_file for this snap is: volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e4b515-eecc-43d1-815b-c453da485082]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:25 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb Sep 08 13:58:25 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:25 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb" returned: 0 in 0.453s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61573c-99b8-4915-95d6-8f980d41a7ef]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:25 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 Sep 08 13:58:25 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:26 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" returned: 0 in 0.431s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:26 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb Sep 08 13:58:26 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:26 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb" returned: 0 in 0.522s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:26 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb Sep 08 13:58:26 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-a4179259-f82d-45e9-8879-8d81434653bf req-e86d2174-f7f1-48c9-b7d7-7efe49a12f47 tempest-TestShelveInstance-169706403 None] Terminate volume connection completed successfully. Sep 08 13:58:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-a4179259-f82d-45e9-8879-8d81434653bf req-e86d2174-f7f1-48c9-b7d7-7efe49a12f47 tempest-TestShelveInstance-169706403 None] Deleting attachment 14d70a98-82a9-4682-be7d-8e7c78e90ecd. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:58:27 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6.c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-quobyte-c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb" released by "_delete_snapshot" :: held 1.854s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-quobyte-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" released by "delete_snapshot" :: held 1.888s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Created reservations ['f71eb328-0520-4189-af78-ee48953344ac', '2fdc3e89-ea21-4256-87fb-705df55aac4f', '597c10d2-0a69-418b-a587-27f50e855656', 'e0fd3429-a57a-4edb-ba4d-f51b60f8268e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:58:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Delete snapshot completed successfully. Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4c472ac9-4a97-4ae6-b4dc-77d9c7dc9d82 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-c1966ce2-3d25-4bcc-8bc4-5e2924d2a7bb-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "cinder-2657dbc7-f59c-4c3e-89b7-18f1c392dda6-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-2657dbc7-f59c-4c3e-89b7-18f1c392dda6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "cinder-quobyte-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-quobyte-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f7641-c1b7-44bd-b7a4-bf5d849a19a3]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:27 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 Sep 08 13:58:27 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:28 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" returned: 0 in 0.384s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:28 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6 Sep 08 13:58:28 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:28 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" returned: 0 in 0.267s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-quobyte-2657dbc7-f59c-4c3e-89b7-18f1c392dda6" released by "delete_volume" :: held 0.720s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Created reservations ['fec47ee5-0806-4fc4-a958-c3c8435b40dc', '7b5c112a-d483-4553-9f13-1fd3057fce29', '41024d65-4eb4-4ba4-9186-29d730f803a8', 'fb463a93-bd74-492a-931d-f766415f1bc6'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:28 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:58:28 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:28 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.299s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:58:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Deleted volume successfully. Sep 08 13:58:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b56a0cd-bb10-40bf-b25a-55b5006bbec0 tempest-SnapshotMetadataTestJSON-1204326859 None] Lock "cinder-2657dbc7-f59c-4c3e-89b7-18f1c392dda6-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ebc2cdc6-7da2-4052-9f25-b5db8abf2e02 req-83fcaf17-6d41-4a55-9a54-536094e7825e tempest-TestShelveInstance-169706403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ebc2cdc6-7da2-4052-9f25-b5db8abf2e02 req-83fcaf17-6d41-4a55-9a54-536094e7825e tempest-TestShelveInstance-169706403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ebc2cdc6-7da2-4052-9f25-b5db8abf2e02 req-83fcaf17-6d41-4a55-9a54-536094e7825e tempest-TestShelveInstance-169706403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ebc2cdc6-7da2-4052-9f25-b5db8abf2e02 req-83fcaf17-6d41-4a55-9a54-536094e7825e tempest-TestShelveInstance-169706403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-54f13a2d-9847-452f-9598-a96546e539dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b39639c-af52-4d7b-bf03-3fe89bff4cdf', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 13:58:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-ebc2cdc6-7da2-4052-9f25-b5db8abf2e02 req-83fcaf17-6d41-4a55-9a54-536094e7825e tempest-TestShelveInstance-169706403 None] attachment_update completed successfully. Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Flow 'volume_create_manager' (9dfe86bb-b340-427f-9d6a-986fb3c5c5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d5a5df-e7d6-436f-b54e-c2e21e7d8d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d5a5df-e7d6-436f-b54e-c2e21e7d8d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1896189966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77441682583e4cdcaf04446e05da2052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:38Z,use_quota=True,user_id='88331a2b4aba4c5f8368282cceab07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948fc397-f712-4ba8-a9ba-d695a6fe5bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948fc397-f712-4ba8-a9ba-d695a6fe5bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18821bea-677b-418a-8b39-1b9740a23ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18821bea-677b-418a-8b39-1b9740a23ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f', 'volume_name': 'volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bba6443-7fc0-4ca9-9ee6-ba944b9b0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bba6443-7fc0-4ca9-9ee6-ba944b9b0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179d2b8c-8faa-4363-a4c1-6cac523e4113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:37 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Volume e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f', 'volume_size': 1} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1896189966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77441682583e4cdcaf04446e05da2052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:38Z,use_quota=True,user_id='88331a2b4aba4c5f8368282cceab07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Creating volume e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:58:37 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:58:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:37 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f 1073741824 Sep 08 13:58:37 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:38 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f 1073741824" returned: 0 in 0.507s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:38 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f Sep 08 13:58:38 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:38 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" returned: 0 in 0.276s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179d2b8c-8faa-4363-a4c1-6cac523e4113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ace2b8-dee8-4ffa-bbc4-8d737b8a785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:38 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Volume volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f (e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f): created successfully Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ace2b8-dee8-4ffa-bbc4-8d737b8a785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Flow 'volume_create_manager' (9dfe86bb-b340-427f-9d6a-986fb3c5c5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b4969e1d-312e-4153-9411-a001a8e4e4e6 tempest-VolumesDeleteCascade-1625379425 None] Created volume successfully. Sep 08 13:58:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Creating offline snapshot 040388c0-429a-4820-be46-b6c7787bf3df of volume e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:58:40 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd522d1-8bc3-42ee-92bb-b5b1df7e31b6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:40 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f Sep 08 13:58:40 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:40 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" returned: 0 in 0.512s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:40 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df 1G Sep 08 13:58:40 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:41 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df 1G" returned: 0 in 0.564s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:41 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df Sep 08 13:58:41 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-004f8dce-6025-4290-9bd1-18929124f545 req-33c386f5-a135-4e42-9c54-37bac8c6970c tempest-TestMinimumBasicScenario-1698418390 None] Terminate volume connection completed successfully. Sep 08 13:58:41 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-004f8dce-6025-4290-9bd1-18929124f545 req-33c386f5-a135-4e42-9c54-37bac8c6970c tempest-TestMinimumBasicScenario-1698418390 None] Deleting attachment 789233a0-92ba-4bdb-a277-1b800fee8453. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:58:41 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df" returned: 0 in 0.329s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:41 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df is being set with open permissions: ugo+rw Sep 08 13:58:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:41 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df Sep 08 13:58:41 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:41 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:41 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.info Sep 08 13:58:41 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:42 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.info" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:42 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.info is being set with open permissions: ugo+rw Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:42 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.info Sep 08 13:58:42 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Acquiring lock "cinder-3f8b0cba-956f-489a-863b-09d30fcf7ef4-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Lock "cinder-3f8b0cba-956f-489a-863b-09d30fcf7ef4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:42 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.info" returned: 0 in 0.326s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Acquiring lock "cinder-quobyte-3f8b0cba-956f-489a-863b-09d30fcf7ef4" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Lock "cinder-quobyte-3f8b0cba-956f-489a-863b-09d30fcf7ef4" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-688481bf-3e98-4479-8d72-2d5942aaa804 tempest-VolumesDeleteCascade-1625379425 None] Create snapshot completed successfully Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef08ffc-d1f3-4097-a3da-9327b5de8ff6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:42 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 Sep 08 13:58:42 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:42 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4" returned: 0 in 0.347s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:42 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4 Sep 08 13:58:42 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:43 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3f8b0cba-956f-489a-863b-09d30fcf7ef4" returned: 0 in 0.252s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Lock "cinder-quobyte-3f8b0cba-956f-489a-863b-09d30fcf7ef4" released by "delete_volume" :: held 0.640s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Created reservations ['89fc7e9a-54f1-485a-ac34-5eb529e8116a', 'cd8c543d-4377-41e1-975c-34d0a0244fdc', 'be85b6a7-b1d4-4047-924c-444fa8ef1b90', 'cd758e16-0104-49b2-a4b1-d980141225cb'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:43 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:58:43 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:43 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.282s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:43 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Deleted volume successfully. Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Creating offline snapshot d7b028ac-7e0a-4e30-af41-21be6bdfc464 of volume e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c5d4b316-b780-4e92-b131-459eb48ce7be tempest-TestMinimumBasicScenario-1698418390 None] Lock "cinder-3f8b0cba-956f-489a-863b-09d30fcf7ef4-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[884fb6fc-a3e3-4f6b-9ecc-d04498ff103f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:43 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df Sep 08 13:58:43 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:44 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df" returned: 0 in 0.499s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:58:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:44 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 1G Sep 08 13:58:44 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:44 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 1G" returned: 0 in 0.765s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:45 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 Sep 08 13:58:45 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:45 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464" returned: 0 in 0.377s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:45 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 is being set with open permissions: ugo+rw Sep 08 13:58:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:45 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 Sep 08 13:58:45 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:45 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464" returned: 0 in 0.348s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-634a525c-d665-4382-b6f1-016ec6bf228e tempest-VolumesDeleteCascade-1625379425 None] Create snapshot completed successfully Sep 08 13:58:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Performing cascade delete. {{(pid=87262) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-040388c0-429a-4820-be46-b6c7787bf3df-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-040388c0-429a-4820-be46-b6c7787bf3df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-040388c0-429a-4820-be46-b6c7787bf3df" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-040388c0-429a-4820-be46-b6c7787bf3df" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Deleting offline snapshot 040388c0-429a-4820-be46-b6c7787bf3df of volume e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] snapshot_file for this snap is: volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0255e8d-c6b4-4b33-9158-bc5ed48d3767]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:47 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df Sep 08 13:58:47 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:47 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df" returned: 0 in 0.406s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6e8662-0180-4303-8ac5-96d1140663ef]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:47 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f Sep 08 13:58:47 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:47 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" returned: 0 in 0.416s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2fb213-54e0-4fc7-a62c-2ec59a44d4da]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:48 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 Sep 08 13:58:48 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:48 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464" returned: 0 in 0.473s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dadce3-827f-4b89-bfb7-47bbd4e16108]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:48 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df Sep 08 13:58:48 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:48 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df" returned: 0 in 0.379s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d2ccbc-c4ae-4112-8c76-e977bcc67215]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:49 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f Sep 08 13:58:49 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:49 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" returned: 0 in 0.475s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:49 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df Sep 08 13:58:49 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:49 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df" returned: 0 in 0.561s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:49 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df Sep 08 13:58:49 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:50 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.040388c0-429a-4820-be46-b6c7787bf3df" returned: 0 in 0.260s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 -F qcow2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:50 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 -F qcow2 Sep 08 13:58:50 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:50 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 -F qcow2" returned: 0 in 0.329s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-040388c0-429a-4820-be46-b6c7787bf3df" released by "_delete_snapshot" :: held 3.490s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" released by "delete_snapshot" :: held 3.512s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Created reservations ['1c1ca0fc-dee7-4828-a67b-5bf7e4b0a554', 'd26b1aec-7df0-45b5-9883-64adea380209', '2f28b575-457f-457d-b221-d8d2368e19ea', 'cc812779-c47c-4ad3-a3f9-bdea1e07b51c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:58:50 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Delete snapshot completed successfully. Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-040388c0-429a-4820-be46-b6c7787bf3df-delete_snapshot" released by "delete_snapshot" :: held 3.752s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-d7b028ac-7e0a-4e30-af41-21be6bdfc464-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-d7b028ac-7e0a-4e30-af41-21be6bdfc464-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-d7b028ac-7e0a-4e30-af41-21be6bdfc464" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-d7b028ac-7e0a-4e30-af41-21be6bdfc464" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Deleting offline snapshot d7b028ac-7e0a-4e30-af41-21be6bdfc464 of volume e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] snapshot_file for this snap is: volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa8913c-b69b-4a45-aea2-5fb7bd7be774]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:50 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 Sep 08 13:58:50 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:51 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464" returned: 0 in 0.450s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:58:51 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4ac04-9580-4fa2-87cd-c25821615898]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:51 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f Sep 08 13:58:51 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:51 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" returned: 0 in 0.383s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:51 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 Sep 08 13:58:51 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:52 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464" returned: 0 in 0.331s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:52 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464 Sep 08 13:58:52 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:52 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f.d7b028ac-7e0a-4e30-af41-21be6bdfc464" returned: 0 in 0.285s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-d7b028ac-7e0a-4e30-af41-21be6bdfc464" released by "_delete_snapshot" :: held 1.549s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" released by "delete_snapshot" :: held 1.572s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Created reservations ['ffd372c8-1bef-4350-a121-1d09edfe3490', 'f5011a0f-93b3-42db-94ba-b51813fea2ad', '00adae79-b897-4347-a806-6dd320760d5c', '97d59875-0e4e-4359-b0b4-cf8d390c9e2c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:58:52 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Delete snapshot completed successfully. Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-d7b028ac-7e0a-4e30-af41-21be6bdfc464-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Snapshots deleted, issuing volume delete {{(pid=87262) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" acquired by "delete_volume" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d8a6d9-edb0-46a6-aceb-403c5f4189a1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:52 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f Sep 08 13:58:52 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:52 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" returned: 0 in 0.364s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:52 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f Sep 08 13:58:52 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:53 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" returned: 0 in 0.272s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f" released by "delete_volume" :: held 0.700s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Created reservations ['3aa15b92-8989-441e-8846-11bbc821f259', '428d3dc3-d774-4988-8aec-1320c4a44849', 'ee46fe3c-e2e1-4bae-a89a-d6e12cfb5388', 'ecba8471-9c03-48f6-a080-35b094481a4a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:53 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:58:53 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:53 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.288s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:58:53 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Deleted volume successfully. Sep 08 13:58:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-333ef8a6-05d1-488c-8a7e-35cc49e95d34 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-e563caaa-b0ec-41d0-bf6c-cab8b4fb7c9f-delete_volume" released by "delete_volume" :: held 6.786s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Flow 'volume_create_manager' (dc90f3c1-7ff4-477a-9d46-59aeb358d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02356fa4-6fbe-4118-becd-e6e969c35e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02356fa4-6fbe-4118-becd-e6e969c35e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1986885977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec70f5e-b79e-4c71-b0d6-2264433bf53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77441682583e4cdcaf04446e05da2052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:54Z,use_quota=True,user_id='88331a2b4aba4c5f8368282cceab07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77558c64-acd9-4a02-8ade-52566483b1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77558c64-acd9-4a02-8ade-52566483b1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740e5595-bcdd-4484-a7fa-a959e3692f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740e5595-bcdd-4484-a7fa-a959e3692f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec70f5e-b79e-4c71-b0d6-2264433bf53b', 'volume_name': 'volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c413869d-9386-4842-a3ae-444531cfe3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c413869d-9386-4842-a3ae-444531cfe3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7822c27e-c9be-4478-8093-1795383b4e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:54 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Volume 5ec70f5e-b79e-4c71-b0d6-2264433bf53b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b', 'volume_size': 1} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1986885977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec70f5e-b79e-4c71-b0d6-2264433bf53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77441682583e4cdcaf04446e05da2052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:54Z,use_quota=True,user_id='88331a2b4aba4c5f8368282cceab07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Creating volume 5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:58:54 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:54 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b 1073741824 Sep 08 13:58:54 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:54 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b 1073741824" returned: 0 in 0.395s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:54 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b Sep 08 13:58:54 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:54 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" returned: 0 in 0.275s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:58:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7822c27e-c9be-4478-8093-1795383b4e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4bcfe7-870f-4a41-971e-11eb423218f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:55 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Volume volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b (5ec70f5e-b79e-4c71-b0d6-2264433bf53b): created successfully Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4bcfe7-870f-4a41-971e-11eb423218f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Flow 'volume_create_manager' (dc90f3c1-7ff4-477a-9d46-59aeb358d0df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8cd8bfa8-f509-4032-8562-8aae0c55e3de tempest-VolumesDeleteCascade-1625379425 None] Created volume successfully. Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Creating offline snapshot ae84e629-08c6-49f8-a45e-963ca17cc898 of volume 5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5491d5ad-7cd5-4673-9227-9a5addb77070]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:55 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b Sep 08 13:58:55 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:55 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" returned: 0 in 0.413s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:55 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 1G Sep 08 13:58:55 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:56 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 1G" returned: 0 in 0.457s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:56 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 Sep 08 13:58:56 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:56 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898" returned: 0 in 0.424s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:56 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 is being set with open permissions: ugo+rw Sep 08 13:58:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:56 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 Sep 08 13:58:56 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:57 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898" returned: 0 in 0.356s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:57 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.info Sep 08 13:58:57 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:57 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.info" returned: 0 in 0.282s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:57 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.info is being set with open permissions: ugo+rw Sep 08 13:58:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:57 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.info Sep 08 13:58:57 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:57 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.info" returned: 0 in 0.287s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-17256380-dec5-449c-8982-72d9a6c3f40f tempest-VolumesDeleteCascade-1625379425 None] Create snapshot completed successfully Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Flow 'volume_create_manager' (55000a1f-a065-4f81-a72f-a2cf5cd601f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a14cdf-b234-4aa9-9be3-ec4fff17c27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a14cdf-b234-4aa9-9be3-ec4fff17c27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1247625323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd0a51e-3598-4fd5-9428-529b2fd76f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77441682583e4cdcaf04446e05da2052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ae84e629-08c6-49f8-a45e-963ca17cc898,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:58:59Z,use_quota=True,user_id='88331a2b4aba4c5f8368282cceab07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470d1962-b4f4-4e47-8500-b8769aa089a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470d1962-b4f4-4e47-8500-b8769aa089a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412ab82c-e90c-44f5-8a4d-523b8b7fd029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412ab82c-e90c-44f5-8a4d-523b8b7fd029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8dd0a51e-3598-4fd5-9428-529b2fd76f41', 'volume_name': 'volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41', 'volume_size': 1, 'snapshot_id': 'ae84e629-08c6-49f8-a45e-963ca17cc898'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3bd763-8905-4566-8308-b1b59333d112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3bd763-8905-4566-8308-b1b59333d112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1dd27d6-d917-4289-bacd-86f29dd1da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:58:59 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Volume 8dd0a51e-3598-4fd5-9428-529b2fd76f41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41', 'volume_size': 1, 'snapshot_id': 'ae84e629-08c6-49f8-a45e-963ca17cc898'} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-ae84e629-08c6-49f8-a45e-963ca17cc898-8dd0a51e-3598-4fd5-9428-529b2fd76f41" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-ae84e629-08c6-49f8-a45e-963ca17cc898-8dd0a51e-3598-4fd5-9428-529b2fd76f41" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Creating volume 8dd0a51e-3598-4fd5-9428-529b2fd76f41 from snapshot ae84e629-08c6-49f8-a45e-963ca17cc898 {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-8dd0a51e-3598-4fd5-9428-529b2fd76f41" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-8dd0a51e-3598-4fd5-9428-529b2fd76f41" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] snapshot: ae84e629-08c6-49f8-a45e-963ca17cc898, volume: 8dd0a51e-3598-4fd5-9428-529b2fd76f41, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6af917-5bea-4ca8-a0e3-6fa6662a89d4]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:59 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 Sep 08 13:58:59 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:58:59 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898" returned: 0 in 0.392s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0045ebae-03ea-4001-8fc1-eebf65164535]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:58:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:58:59 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b Sep 08 13:58:59 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:00 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" returned: 0 in 0.391s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 13:59:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 13:59:00 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 13:59:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:00 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 Sep 08 13:59:00 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:03 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:59:03 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:03 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.692s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 13:59:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 13:59:05 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41" returned: 0 in 5.140s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 13:59:05 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Converted 1024.00 MB image at 199.19 MB/s Sep 08 13:59:05 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 is being set with open permissions: ugo+rw Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:05 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 Sep 08 13:59:05 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:05 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41" returned: 0 in 0.282s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-8dd0a51e-3598-4fd5-9428-529b2fd76f41" released by "_copy_volume_from_snapshot" :: held 6.297s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=70,cinder:INSERT=24,cinder:UPDATE=69,cinder:DELETE=8 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=71,cinder:SELECT=81,cinder:INSERT=24,cinder:DELETE=4 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-ae84e629-08c6-49f8-a45e-963ca17cc898-8dd0a51e-3598-4fd5-9428-529b2fd76f41" released by "_create_volume_from_snapshot" :: held 6.379s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.394s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1dd27d6-d917-4289-bacd-86f29dd1da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41', 'volume_size': 1, 'snapshot_id': 'ae84e629-08c6-49f8-a45e-963ca17cc898'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81864c9e-7a37-4e16-a6de-37ce250a2098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:05 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Volume volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 (8dd0a51e-3598-4fd5-9428-529b2fd76f41): created successfully Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81864c9e-7a37-4e16-a6de-37ce250a2098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Flow 'volume_create_manager' (55000a1f-a065-4f81-a72f-a2cf5cd601f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:59:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-dc358f7d-65c0-42d6-9229-5297b6e5b644 tempest-VolumesDeleteCascade-1625379425 None] Created volume successfully. Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-5ec70f5e-b79e-4c71-b0d6-2264433bf53b-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-5ec70f5e-b79e-4c71-b0d6-2264433bf53b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Performing cascade delete. {{(pid=87262) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-ae84e629-08c6-49f8-a45e-963ca17cc898-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-ae84e629-08c6-49f8-a45e-963ca17cc898-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-ae84e629-08c6-49f8-a45e-963ca17cc898" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-ae84e629-08c6-49f8-a45e-963ca17cc898" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Deleting offline snapshot ae84e629-08c6-49f8-a45e-963ca17cc898 of volume 5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] snapshot_file for this snap is: volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b7bbb3-a817-41de-8322-2c115a493f3a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:06 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 Sep 08 13:59:06 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:06 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898" returned: 0 in 0.432s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[664c9da7-3f45-4386-9109-21b5e2da4567]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:59:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:06 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b Sep 08 13:59:06 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:07 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" returned: 0 in 0.541s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:07 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 Sep 08 13:59:07 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:07 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898" returned: 0 in 0.398s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:07 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898 Sep 08 13:59:07 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:08 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b.ae84e629-08c6-49f8-a45e-963ca17cc898" returned: 0 in 0.307s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-ae84e629-08c6-49f8-a45e-963ca17cc898" released by "_delete_snapshot" :: held 1.790s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" released by "delete_snapshot" :: held 1.817s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Created reservations ['7fe85c61-cbbf-461f-b678-919a7f6665ab', '811f2604-480c-4b30-bcd7-a54a6bfd7de7', '994c385b-c3e4-428a-9264-1d6d943a74d4', '2f7d7cf9-3eb1-4584-97ba-60361417de50'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:59:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Delete snapshot completed successfully. Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-ae84e629-08c6-49f8-a45e-963ca17cc898-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Snapshots deleted, issuing volume delete {{(pid=87262) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" acquired by "delete_volume" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[37758312-8062-4fa5-b7c0-30465adcffe5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:08 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b Sep 08 13:59:08 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:08 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" returned: 0 in 0.391s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:08 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b Sep 08 13:59:08 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:08 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" returned: 0 in 0.266s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-5ec70f5e-b79e-4c71-b0d6-2264433bf53b" released by "delete_volume" :: held 0.719s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Created reservations ['06d0bef0-0c3e-4dc8-a9d4-208cfe72a2a0', '8ec1a40c-3361-4a61-8d5c-cf2c92ada3ef', '9a8f2216-f271-48a5-bcaf-b636cbdb613f', 'e6b24432-b6d9-4a89-8112-0a5fa4bae29a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:09 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:59:09 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:09 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.257s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:59:09 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Deleted volume successfully. Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f016dc9-265f-4c38-ab4b-f8d22b754e90 tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-5ec70f5e-b79e-4c71-b0d6-2264433bf53b-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-8dd0a51e-3598-4fd5-9428-529b2fd76f41-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-8dd0a51e-3598-4fd5-9428-529b2fd76f41-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "cinder-quobyte-8dd0a51e-3598-4fd5-9428-529b2fd76f41" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-8dd0a51e-3598-4fd5-9428-529b2fd76f41" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3527da-db45-4900-8f18-c1b58d317b29]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:59:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:09 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 Sep 08 13:59:09 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:10 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41" returned: 0 in 0.417s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:10 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41 Sep 08 13:59:10 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:10 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dd0a51e-3598-4fd5-9428-529b2fd76f41" returned: 0 in 0.292s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-quobyte-8dd0a51e-3598-4fd5-9428-529b2fd76f41" released by "delete_volume" :: held 0.757s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Created reservations ['0c82d65c-5002-4fad-9aa5-8acc09b9857d', '37eba9bf-f0cb-4806-9082-05379dc7792c', '8db4d0fb-755d-47a2-a8e3-67f53a25cc2a', 'fdaa1d36-7e9c-4666-9671-f1873fdca102'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:10 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:59:10 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:10 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.290s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:59:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Deleted volume successfully. Sep 08 13:59:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fc65d1e9-e9bd-40e1-b070-251c49c048ee tempest-VolumesDeleteCascade-1625379425 None] Lock "cinder-8dd0a51e-3598-4fd5-9428-529b2fd76f41-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-e8f65a09-83fe-464b-b785-cc4b3361ce05 tempest-TestShelveInstance-169706403 None] Terminate volume connection completed successfully. Sep 08 13:59:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-e8f65a09-83fe-464b-b785-cc4b3361ce05 tempest-TestShelveInstance-169706403 None] Deleting attachment 0b39639c-af52-4d7b-bf03-3fe89bff4cdf. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Acquiring lock "cinder-54f13a2d-9847-452f-9598-a96546e539dc-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Lock "cinder-54f13a2d-9847-452f-9598-a96546e539dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Acquiring lock "cinder-quobyte-54f13a2d-9847-452f-9598-a96546e539dc" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Lock "cinder-quobyte-54f13a2d-9847-452f-9598-a96546e539dc" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ccf5f4-aa6c-414e-8858-e9b74b5c1063]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:16 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc Sep 08 13:59:16 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:16 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc" returned: 0 in 0.503s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:16 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc Sep 08 13:59:16 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:16 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-54f13a2d-9847-452f-9598-a96546e539dc" returned: 0 in 0.311s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Lock "cinder-quobyte-54f13a2d-9847-452f-9598-a96546e539dc" released by "delete_volume" :: held 0.880s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.quota [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Created reservations ['7ea79f21-2d80-4cf2-b2dd-d99f9b7987c7', 'c1e1490b-8bb9-46ab-ba3f-43eed39870e4', '9cd1b0cb-b99a-4876-80fc-86c6f62e2f27', '5462f7d9-d03c-4636-ae6b-22a2abca8b6f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:17 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:59:17 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:17 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.357s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.manager [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:59:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Deleted volume successfully. Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [req-d270fa2f-19e4-49b9-bc4a-c8c37dc3c6e3 req-6d83947e-66eb-48da-a616-0a4a84456398 tempest-TestShelveInstance-169706403 None] Lock "cinder-54f13a2d-9847-452f-9598-a96546e539dc-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Flow 'volume_create_manager' (57271842-85d0-463b-af73-115e1cc02c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e623ff-9c27-445e-8cfc-37acd3f49771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e623ff-9c27-445e-8cfc-37acd3f49771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-380023994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33195bd5-b091-406b-affb-8dc8f4f35d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c24e04ad20641978f0ccbcfd0f7300c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:59:18Z,use_quota=True,user_id='f0fd2ae90e7a48dcb27836b8e085eef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d31c5d-c9bc-4e4a-98da-89247e33e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d31c5d-c9bc-4e4a-98da-89247e33e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea4fb38-0752-4351-bdb9-280729ecadd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea4fb38-0752-4351-bdb9-280729ecadd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33195bd5-b091-406b-affb-8dc8f4f35d84', 'volume_name': 'volume-33195bd5-b091-406b-affb-8dc8f4f35d84', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79178dfc-d7f1-4e37-8b2c-564e10ce9cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79178dfc-d7f1-4e37-8b2c-564e10ce9cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea9026e-a9c9-4457-ba68-b5c9f6243fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:17 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Volume 33195bd5-b091-406b-affb-8dc8f4f35d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33195bd5-b091-406b-affb-8dc8f4f35d84', 'volume_size': 1} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-380023994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33195bd5-b091-406b-affb-8dc8f4f35d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c24e04ad20641978f0ccbcfd0f7300c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:59:18Z,use_quota=True,user_id='f0fd2ae90e7a48dcb27836b8e085eef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Creating volume 33195bd5-b091-406b-affb-8dc8f4f35d84 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:59:17 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:59:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:17 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 1073741824 Sep 08 13:59:17 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:18 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 1073741824" returned: 0 in 0.564s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:18 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 Sep 08 13:59:18 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:18 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84" returned: 0 in 0.305s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea9026e-a9c9-4457-ba68-b5c9f6243fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33195bd5-b091-406b-affb-8dc8f4f35d84', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f28cc1-737f-43ad-b8a0-aa15df92d77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:18 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Volume volume-33195bd5-b091-406b-affb-8dc8f4f35d84 (33195bd5-b091-406b-affb-8dc8f4f35d84): created successfully Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f28cc1-737f-43ad-b8a0-aa15df92d77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Flow 'volume_create_manager' (57271842-85d0-463b-af73-115e1cc02c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:59:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-92e00664-780b-4b7e-b6d6-a0cafb16d5a5 tempest-VolumesTransfersV357Test-1715083139 None] Created volume successfully. Sep 08 13:59:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0b631ade-9869-447e-8ffe-212450198759 tempest-VolumesTransfersV357Test-1703739541 None] Transfer volume completed successfully. Sep 08 13:59:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Acquiring lock "cinder-33195bd5-b091-406b-affb-8dc8f4f35d84-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Lock "cinder-33195bd5-b091-406b-affb-8dc8f4f35d84-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Acquiring lock "cinder-quobyte-33195bd5-b091-406b-affb-8dc8f4f35d84" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Lock "cinder-quobyte-33195bd5-b091-406b-affb-8dc8f4f35d84" acquired by "delete_volume" :: waited 0.036s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6390d2e-3301-4062-8b5e-36f65c6ce7aa]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:59:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:21 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 Sep 08 13:59:21 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:21 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84" returned: 0 in 0.406s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:21 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84 Sep 08 13:59:21 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:22 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-33195bd5-b091-406b-affb-8dc8f4f35d84" returned: 0 in 0.242s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Lock "cinder-quobyte-33195bd5-b091-406b-affb-8dc8f4f35d84" released by "delete_volume" :: held 0.698s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Created reservations ['751048f1-c7ec-46d6-86f7-1b54afe8dc23', '9e14e032-f3ef-4a11-a5c6-7a5ed35fec1a', '0692aee3-9674-46df-a62a-3f97540cb269', 'f7c70132-2d72-4c60-8c18-6634a5513282'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:22 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:59:22 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:22 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.406s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:59:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Deleted volume successfully. Sep 08 13:59:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7e517be0-8b17-4d2b-86df-e42ae2cc4af9 tempest-VolumesTransfersV357Test-1665974019 None] Lock "cinder-33195bd5-b091-406b-affb-8dc8f4f35d84-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Flow 'volume_create_manager' (5b631c72-c2a3-40a7-95f3-a308bf80b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1784d851-dd15-4e9d-b1ad-d18df50a3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1784d851-dd15-4e9d-b1ad-d18df50a3e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-691878704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d917f44-bd70-4945-94fb-c03579e0e8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c24e04ad20641978f0ccbcfd0f7300c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:59:23Z,use_quota=True,user_id='f0fd2ae90e7a48dcb27836b8e085eef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a34600-0dbc-49f0-8380-f7584fe25881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a34600-0dbc-49f0-8380-f7584fe25881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40591ff4-ebce-43b5-9069-b6f2ab8a1fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40591ff4-ebce-43b5-9069-b6f2ab8a1fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d917f44-bd70-4945-94fb-c03579e0e8fb', 'volume_name': 'volume-7d917f44-bd70-4945-94fb-c03579e0e8fb', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04dfd8cf-30d2-4fe8-8d2c-a8ccd646af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04dfd8cf-30d2-4fe8-8d2c-a8ccd646af32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52db9919-508b-4700-9dd9-199738d9b320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:23 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Volume 7d917f44-bd70-4945-94fb-c03579e0e8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d917f44-bd70-4945-94fb-c03579e0e8fb', 'volume_size': 1} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-691878704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d917f44-bd70-4945-94fb-c03579e0e8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c24e04ad20641978f0ccbcfd0f7300c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:59:23Z,use_quota=True,user_id='f0fd2ae90e7a48dcb27836b8e085eef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Creating volume 7d917f44-bd70-4945-94fb-c03579e0e8fb {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:59:23 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:23 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb 1073741824 Sep 08 13:59:23 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:23 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb 1073741824" returned: 0 in 0.561s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:24 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb Sep 08 13:59:24 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:24 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb" returned: 0 in 0.326s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:59:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52db9919-508b-4700-9dd9-199738d9b320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d917f44-bd70-4945-94fb-c03579e0e8fb', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b462f57-adf1-468c-a113-19fa2a09b4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Volume volume-7d917f44-bd70-4945-94fb-c03579e0e8fb (7d917f44-bd70-4945-94fb-c03579e0e8fb): created successfully Sep 08 13:59:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b462f57-adf1-468c-a113-19fa2a09b4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Flow 'volume_create_manager' (5b631c72-c2a3-40a7-95f3-a308bf80b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:59:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fcdb4afd-7f3e-4c07-922b-54d09840a3ce tempest-VolumesTransfersV357Test-1715083139 None] Created volume successfully. Sep 08 13:59:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Acquiring lock "cinder-7d917f44-bd70-4945-94fb-c03579e0e8fb-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Lock "cinder-7d917f44-bd70-4945-94fb-c03579e0e8fb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Acquiring lock "cinder-quobyte-7d917f44-bd70-4945-94fb-c03579e0e8fb" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 13:59:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Lock "cinder-quobyte-7d917f44-bd70-4945-94fb-c03579e0e8fb" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 13:59:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8042fdec-7f40-45bd-ae90-f84b1ad42ae0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 13:59:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:25 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb Sep 08 13:59:25 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:26 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb" returned: 0 in 0.455s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:26 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb Sep 08 13:59:26 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:26 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7d917f44-bd70-4945-94fb-c03579e0e8fb" returned: 0 in 0.288s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Lock "cinder-quobyte-7d917f44-bd70-4945-94fb-c03579e0e8fb" released by "delete_volume" :: held 0.801s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Created reservations ['d43b9254-818d-405b-9f55-1f3339c05441', '91f6655d-d947-47b8-b8e6-da4ffeefdc6b', 'ad8528f0-87dd-4ea8-931b-cb2066082740', '81adc03b-f2c1-4f82-a2ee-6cfeb1c9f7ca'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:26 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 13:59:26 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:27 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.376s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:27 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 13:59:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Deleted volume successfully. Sep 08 13:59:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f2e66022-03b6-4a0a-aa7b-1ba08fde1764 tempest-VolumesTransfersV357Test-1665974019 None] Lock "cinder-7d917f44-bd70-4945-94fb-c03579e0e8fb-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 13:59:41 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=55,cinder:SELECT=29,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:59:41 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=46,cinder:INSERT=12,cinder:UPDATE=53,cinder:DELETE=4 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Flow 'volume_create_manager' (3c2278d0-aa30-48d5-a04a-09b7f50f94b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f1c987-a945-4a80-b949-dadb2da701e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f1c987-a945-4a80-b949-dadb2da701e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1109869718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1febb1-9993-4634-80c9-c0551370b05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721f1209911d4e29a9b2ecab17872a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:59:50Z,use_quota=True,user_id='b188d9b39bbc4a6e974dac140c82f77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f192a74-e899-4766-93c3-2c570e0accce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f192a74-e899-4766-93c3-2c570e0accce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e79404-d404-4499-b32e-6110806aa386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e79404-d404-4499-b32e-6110806aa386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1febb1-9993-4634-80c9-c0551370b05e', 'volume_name': 'volume-5f1febb1-9993-4634-80c9-c0551370b05e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd4688c-10b1-46f7-9abe-df24f5ac8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd4688c-10b1-46f7-9abe-df24f5ac8229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e049a5-c073-4aff-a441-36a3e32097dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Volume 5f1febb1-9993-4634-80c9-c0551370b05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1febb1-9993-4634-80c9-c0551370b05e', 'volume_size': 1} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T11:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1109869718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1febb1-9993-4634-80c9-c0551370b05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721f1209911d4e29a9b2ecab17872a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T11:59:50Z,use_quota=True,user_id='b188d9b39bbc4a6e974dac140c82f77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Creating volume 5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 13:59:50 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 13:59:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:50 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e 1073741824 Sep 08 13:59:50 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:51 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e 1073741824" returned: 0 in 0.711s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 13:59:51 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 13:59:51 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 13:59:51 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.354s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e049a5-c073-4aff-a441-36a3e32097dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1febb1-9993-4634-80c9-c0551370b05e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a37b58e-14ad-49b9-a19c-61aa405034d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 13:59:51 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Volume volume-5f1febb1-9993-4634-80c9-c0551370b05e (5f1febb1-9993-4634-80c9-c0551370b05e): created successfully Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a37b58e-14ad-49b9-a19c-61aa405034d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 13:59:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Flow 'volume_create_manager' (3c2278d0-aa30-48d5-a04a-09b7f50f94b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 13:59:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-69572b55-5d01-46c3-b9c8-efa7bb26409f tempest-VolumesActionsTest-616702965 None] Created volume successfully. Sep 08 14:00:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c31d7c0c-b660-42ae-8ca0-7aa487afd7b6 tempest-VolumesActionsTest-616702965 None] Acquiring lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e" by "attach_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:00:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c31d7c0c-b660-42ae-8ca0-7aa487afd7b6 tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e" acquired by "attach_volume" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:00:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c31d7c0c-b660-42ae-8ca0-7aa487afd7b6 tempest-VolumesActionsTest-616702965 None] Attaching volume 5f1febb1-9993-4634-80c9-c0551370b05e to instance 257d7b28-a4fa-408b-bd41-a7b362d2eefc at mountpoint /dev/vdb on host None. Sep 08 14:00:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c31d7c0c-b660-42ae-8ca0-7aa487afd7b6 tempest-VolumesActionsTest-616702965 None] Attach volume completed successfully. Sep 08 14:00:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c31d7c0c-b660-42ae-8ca0-7aa487afd7b6 tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e" released by "attach_volume" :: held 0.155s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:00:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f3d4c2a8-6b06-44c1-8b4c-d676198a7647 tempest-VolumesActionsTest-616702965 None] Acquiring lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-detach_volume" by "detach_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:00:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f3d4c2a8-6b06-44c1-8b4c-d676198a7647 tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:00:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f3d4c2a8-6b06-44c1-8b4c-d676198a7647 tempest-VolumesActionsTest-616702965 None] Detaching volume 5f1febb1-9993-4634-80c9-c0551370b05e from instance 257d7b28-a4fa-408b-bd41-a7b362d2eefc. Sep 08 14:00:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f3d4c2a8-6b06-44c1-8b4c-d676198a7647 tempest-VolumesActionsTest-616702965 None] Detach volume completed successfully. Sep 08 14:00:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f3d4c2a8-6b06-44c1-8b4c-d676198a7647 tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:03 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:00:03 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:03 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.422s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 14:00:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Flow 'volume_create_manager' (6a198966-5709-49cb-93ea-c9022032e0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9783b26-d6e9-4408-8f28-faa82813536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9783b26-d6e9-4408-8f28-faa82813536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1423027709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2557d9cc-5d83-4c33-abc2-bdafc9b58e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b6261abe1483596d5ddd89531578d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:00:07Z,use_quota=True,user_id='b8b7af3fbe634f8e86e639da528dc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb88e9-3d5a-4950-8b24-c5f2eb7bd655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb88e9-3d5a-4950-8b24-c5f2eb7bd655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f408319-9b2a-4526-bc26-b8f6849c7c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f408319-9b2a-4526-bc26-b8f6849c7c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2557d9cc-5d83-4c33-abc2-bdafc9b58e39', 'volume_name': 'volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d049c7-6a5a-42c4-872b-8b0c1d0cc635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d049c7-6a5a-42c4-872b-8b0c1d0cc635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be35e7a4-7ca5-4146-b9f2-095729c1d9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:07 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Volume 2557d9cc-5d83-4c33-abc2-bdafc9b58e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39', 'volume_size': 1} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1423027709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2557d9cc-5d83-4c33-abc2-bdafc9b58e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b6261abe1483596d5ddd89531578d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:00:07Z,use_quota=True,user_id='b8b7af3fbe634f8e86e639da528dc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Creating volume 2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:00:07 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:07 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 1073741824 Sep 08 14:00:07 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:07 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Flow 'volume_create_manager' (7e1fc927-932f-4066-8ad8-5f9fc237424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8052ee8b-8ed5-4cb2-931c-e47fd4f4397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8052ee8b-8ed5-4cb2-931c-e47fd4f4397b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-812386056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dac2295-2849-456c-a83c-9db9c5e3955d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e4101f9507424c831d69608fedb909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:00:08Z,use_quota=True,user_id='6e703a0d73b14bc6948d0dc29a43c24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41fd992-b34e-4b7c-beb8-c899c00c9cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41fd992-b34e-4b7c-beb8-c899c00c9cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fc570a-a343-4528-a2e7-0b9881e26e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fc570a-a343-4528-a2e7-0b9881e26e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dac2295-2849-456c-a83c-9db9c5e3955d', 'volume_name': 'volume-8dac2295-2849-456c-a83c-9db9c5e3955d', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1036513-846b-4ff9-a9ab-bd737d940668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1036513-846b-4ff9-a9ab-bd737d940668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde3f036-3ea9-49b2-87ee-f6584810fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:08 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Volume 8dac2295-2849-456c-a83c-9db9c5e3955d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dac2295-2849-456c-a83c-9db9c5e3955d', 'volume_size': 1} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:08 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 1073741824" returned: 0 in 0.634s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:08 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 Sep 08 14:00:08 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:08 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" returned: 0 in 0.379s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-812386056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dac2295-2849-456c-a83c-9db9c5e3955d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e4101f9507424c831d69608fedb909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:00:08Z,use_quota=True,user_id='6e703a0d73b14bc6948d0dc29a43c24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Creating volume 8dac2295-2849-456c-a83c-9db9c5e3955d {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:00:08 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:08 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d 1073741824 Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be35e7a4-7ca5-4146-b9f2-095729c1d9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:08 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02f07ad-3e66-4592-a933-284454bacb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:08 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Volume volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 (2557d9cc-5d83-4c33-abc2-bdafc9b58e39): created successfully Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02f07ad-3e66-4592-a933-284454bacb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Flow 'volume_create_manager' (6a198966-5709-49cb-93ea-c9022032e0dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:00:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-eb6e5446-8e9f-49e6-b87a-5abc2e737c2e tempest-TestStampPattern-1484049102 None] Created volume successfully. Sep 08 14:00:09 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d 1073741824" returned: 0 in 0.768s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:09 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d Sep 08 14:00:09 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:09 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d" returned: 0 in 0.401s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:00:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde3f036-3ea9-49b2-87ee-f6584810fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dac2295-2849-456c-a83c-9db9c5e3955d', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b490b45-234f-4096-8073-ff60727f85b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:00:10 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Volume volume-8dac2295-2849-456c-a83c-9db9c5e3955d (8dac2295-2849-456c-a83c-9db9c5e3955d): created successfully Sep 08 14:00:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b490b45-234f-4096-8073-ff60727f85b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:00:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Flow 'volume_create_manager' (7e1fc927-932f-4066-8ad8-5f9fc237424c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:00:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-bb2c4b4a-d873-4617-ba41-1841b6392afe tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Created volume successfully. Sep 08 14:00:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-04eb2399-7cbc-4fbc-a8b5-ac75d38cf9d4 req-868ccddb-c409-443f-ac18-2d2454ec0452 tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-04eb2399-7cbc-4fbc-a8b5-ac75d38cf9d4 req-868ccddb-c409-443f-ac18-2d2454ec0452 tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-04eb2399-7cbc-4fbc-a8b5-ac75d38cf9d4 req-868ccddb-c409-443f-ac18-2d2454ec0452 tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-04eb2399-7cbc-4fbc-a8b5-ac75d38cf9d4 req-868ccddb-c409-443f-ac18-2d2454ec0452 tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-8dac2295-2849-456c-a83c-9db9c5e3955d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94aaabaf-03ce-40ec-b088-20b98d9d075a', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 14:00:12 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-04eb2399-7cbc-4fbc-a8b5-ac75d38cf9d4 req-868ccddb-c409-443f-ac18-2d2454ec0452 tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] attachment_update completed successfully. Sep 08 14:00:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b102982-d452-4f52-8ae0-fa111a7a3018 tempest-VolumesActionsTest-616702965 None] Acquiring lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e" by "attach_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:00:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b102982-d452-4f52-8ae0-fa111a7a3018 tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e" acquired by "attach_volume" :: waited 0.062s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:00:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7b102982-d452-4f52-8ae0-fa111a7a3018 tempest-VolumesActionsTest-616702965 None] Attaching volume 5f1febb1-9993-4634-80c9-c0551370b05e to instance 20d4ef4a-f0dd-4bbd-905a-a0dd2cd6f1fe at mountpoint /dev/vdb on host None. Sep 08 14:00:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7b102982-d452-4f52-8ae0-fa111a7a3018 tempest-VolumesActionsTest-616702965 None] Attach volume completed successfully. Sep 08 14:00:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b102982-d452-4f52-8ae0-fa111a7a3018 tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e" released by "attach_volume" :: held 0.420s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:00:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-06f96044-4ad7-4572-87de-d61c0dc949f4 req-c78ad303-e260-41cf-8e11-87d2bad680d6 tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Terminate volume connection completed successfully. Sep 08 14:00:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-06f96044-4ad7-4572-87de-d61c0dc949f4 req-c78ad303-e260-41cf-8e11-87d2bad680d6 tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Deleting attachment 94aaabaf-03ce-40ec-b088-20b98d9d075a. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 14:00:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-090aada7-8148-466d-8459-a6abf876ce5d tempest-VolumesActionsTest-616702965 None] Acquiring lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-detach_volume" by "detach_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:00:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-090aada7-8148-466d-8459-a6abf876ce5d tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:00:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-090aada7-8148-466d-8459-a6abf876ce5d tempest-VolumesActionsTest-616702965 None] Detaching volume 5f1febb1-9993-4634-80c9-c0551370b05e from instance 20d4ef4a-f0dd-4bbd-905a-a0dd2cd6f1fe. Sep 08 14:00:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-090aada7-8148-466d-8459-a6abf876ce5d tempest-VolumesActionsTest-616702965 None] Detach volume completed successfully. Sep 08 14:00:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-090aada7-8148-466d-8459-a6abf876ce5d tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:00:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Acquiring lock "cinder-8dac2295-2849-456c-a83c-9db9c5e3955d-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:00:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "cinder-8dac2295-2849-456c-a83c-9db9c5e3955d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:00:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Acquiring lock "cinder-quobyte-8dac2295-2849-456c-a83c-9db9c5e3955d" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:00:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "cinder-quobyte-8dac2295-2849-456c-a83c-9db9c5e3955d" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:00:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[668cb578-ccb5-43d8-986a-ab4e5f2d9f3d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:00:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:20 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d Sep 08 14:00:20 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:20 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d" returned: 0 in 0.644s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:20 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d Sep 08 14:00:20 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:21 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8dac2295-2849-456c-a83c-9db9c5e3955d" returned: 0 in 0.461s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "cinder-quobyte-8dac2295-2849-456c-a83c-9db9c5e3955d" released by "delete_volume" :: held 1.161s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Created reservations ['0a9d5f47-c78e-47be-94b0-8f2a35f811ad', 'db6bcf4b-ea9b-4616-888c-0f9ed7c09dca', 'ed913c34-1293-4ea7-b24f-46bca6be1457', 'c2807917-1012-4934-b204-689868662eca'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:21 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:00:21 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:21 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.280s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:00:21 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Deleted volume successfully. Sep 08 14:00:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cb755470-1546-4077-b24b-8d2ba6d4d79b tempest-TestServerVolumeAttachScenarioOldVersion-1865674520 None] Lock "cinder-8dac2295-2849-456c-a83c-9db9c5e3955d-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:00:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:24 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[efedad60-4efa-4b60-8963-d633f88d339f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:00:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:24 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 14:00:24 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:24 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.400s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34056a7-0e13-41c9-bd88-2a2d04a98fb5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:00:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:25 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 14:00:25 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:25 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.434s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.58e307f5-a718-456a-9c5c-3a49c0ec371ehgr7aih7.img {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:25 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.58e307f5-a718-456a-9c5c-3a49c0ec371ehgr7aih7.img Sep 08 14:00:25 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:31 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=30,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:00:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.58e307f5-a718-456a-9c5c-3a49c0ec371ehgr7aih7.img" returned: 0 in 6.330s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:31 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f614c860-a3cd-4755-b32e-3772968638c6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:00:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:31 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 14:00:31 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:32 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.567s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:32 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.58e307f5-a718-456a-9c5c-3a49c0ec371ehgr7aih7.img {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:00:32 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Converted 1024.00 MB image at 161.72 MB/s Sep 08 14:00:32 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] 58e307f5-a718-456a-9c5c-3a49c0ec371e was raw, no need to convert to raw {{(pid=87262) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 14:00:42 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=35,cinder:UPDATE=18,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:00:42 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:00:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-955dfcfc-1d91-484d-94fc-f10bb4a1e1d1 req-fafcaf24-5ed1-457e-8066-3374d978b6a5 tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.945s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Uploaded volume to glance image-id: 58e307f5-a718-456a-9c5c-3a49c0ec371e. {{(pid=87262) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 14:00:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-955dfcfc-1d91-484d-94fc-f10bb4a1e1d1 req-fafcaf24-5ed1-457e-8066-3374d978b6a5 tempest-TestStampPattern-1484049102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.169s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-955dfcfc-1d91-484d-94fc-f10bb4a1e1d1 req-fafcaf24-5ed1-457e-8066-3374d978b6a5 tempest-TestStampPattern-1484049102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:00:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f11106ab-c6a4-411a-9d96-d3ecfa3fa8d2 tempest-VolumesActionsTest-616702965 None] Copy volume to image completed successfully. Sep 08 14:00:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-955dfcfc-1d91-484d-94fc-f10bb4a1e1d1 req-fafcaf24-5ed1-457e-8066-3374d978b6a5 tempest-TestStampPattern-1484049102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16efac52-3d92-478c-8b84-4d2b43e26fc7', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 14:00:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-955dfcfc-1d91-484d-94fc-f10bb4a1e1d1 req-fafcaf24-5ed1-457e-8066-3374d978b6a5 tempest-TestStampPattern-1484049102 None] attachment_update completed successfully. Sep 08 14:00:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:00:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:00:56 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e97bc39-86ea-4350-baf3-4debba6d6d03]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:00:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:56 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 14:00:56 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:57 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:57 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e524f6-ead9-45f0-a0c0-de3e2fb03a86]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:00:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:57 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 14:00:57 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:00:57 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Sep 08 14:00:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.403s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:00:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:00:57 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img Sep 08 14:00:57 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-beaa9b65-eb7a-40c4-9e87-1379a261ac9d req-1de3f380-9c92-4ac3-8d35-939d710fe10f tempest-TestStampPattern-1484049102 None] Terminate volume connection completed successfully. Sep 08 14:01:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-beaa9b65-eb7a-40c4-9e87-1379a261ac9d req-1de3f380-9c92-4ac3-8d35-939d710fe10f tempest-TestStampPattern-1484049102 None] Deleting attachment 16efac52-3d92-478c-8b84-4d2b43e26fc7. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 14:01:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:02 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img" returned: 0 in 5.255s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:02 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c2fab-8115-49fb-9049-2e2cbbdc5400]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:02 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 14:01:02 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:03 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:01:03 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:03 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.560s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:01:03 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Converted 1024.00 MB image at 194.82 MB/s Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] 8fe86f9e-f584-4303-8f63-349cdabae942 was raw, converting to qcow2 {{(pid=87262) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc140fdf-458d-42c8-9c1e-c32ad8ea4ebc]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:03 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.309s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 14:01:03 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img Sep 08 14:01:03 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:03 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img" returned: 0 in 0.344s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:03 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img Sep 08 14:01:03 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:04 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img" returned: 1 in 0.332s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:01:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img /opt/stack/data/cinder/conversion/vol_upload_kfvb6d1s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:04 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img /opt/stack/data/cinder/conversion/vol_upload_kfvb6d1s Sep 08 14:01:04 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:04 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img /opt/stack/data/cinder/conversion/vol_upload_kfvb6d1s" returned: 0 in 0.266s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:04 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Image conversion details: src /opt/stack/data/cinder/conversion/5f1febb1-9993-4634-80c9-c0551370b05e.temp_image.8fe86f9e-f584-4303-8f63-349cdabae942jbkbjmo1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kfvb6d1s {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:01:04 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 08 14:01:04 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7fe499-bf87-405f-a194-54783951a127]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kfvb6d1s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:04 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kfvb6d1s Sep 08 14:01:04 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:04 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kfvb6d1s" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.551s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:06 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Uploaded volume to glance image-id: 8fe86f9e-f584-4303-8f63-349cdabae942. {{(pid=87262) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 14:01:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.333s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Creating offline snapshot 40b97d13-d587-42d3-9561-a06c4cf26cf7 of volume 2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:01:06 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-40742dbf-087f-455c-a01a-76674cb3f818 tempest-VolumesActionsTest-616702965 None] Copy volume to image completed successfully. Sep 08 14:01:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e2ca59-61ab-4fbe-9cba-1d01d7b757d9]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:06 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 Sep 08 14:01:06 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:06 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" returned: 0 in 0.376s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:06 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 1G Sep 08 14:01:06 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:07 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 1G" returned: 0 in 0.480s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:07 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 Sep 08 14:01:07 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:07 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7" returned: 0 in 0.348s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:07 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 is being set with open permissions: ugo+rw Sep 08 14:01:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:07 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 Sep 08 14:01:07 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:07 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7" returned: 0 in 0.276s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:07 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.info Sep 08 14:01:07 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:08 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.info" returned: 0 in 0.287s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:08 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.info is being set with open permissions: ugo+rw Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:08 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.info Sep 08 14:01:08 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Acquiring lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:08 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.info" returned: 0 in 0.292s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Acquiring lock "cinder-quobyte-5f1febb1-9993-4634-80c9-c0551370b05e" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8a958205-8352-486b-ba7b-3768ba73f287 tempest-TestStampPattern-1484049102 None] Create snapshot completed successfully Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Lock "cinder-quobyte-5f1febb1-9993-4634-80c9-c0551370b05e" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[432d51f3-151a-452a-9fe3-2b6999449416]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:08 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 14:01:08 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:08 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.392s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:09 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e Sep 08 14:01:09 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:09 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5f1febb1-9993-4634-80c9-c0551370b05e" returned: 0 in 0.272s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Lock "cinder-quobyte-5f1febb1-9993-4634-80c9-c0551370b05e" released by "delete_volume" :: held 0.707s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Created reservations ['40995dc9-2114-4ffb-b9d0-89d497c61190', 'b34e9364-5b81-45eb-9b6f-65c3d2bf8272', 'f67b7d50-9d6b-4a43-b363-49050188ab54', '865c2eb4-ab97-4b7e-bc29-6470dc6beb0b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:09 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:01:09 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:09 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.336s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:01:09 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Deleted volume successfully. Sep 08 14:01:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c25a4509-1da9-4401-8b7a-bc712678a4ba tempest-VolumesActionsTest-616702965 None] Lock "cinder-5f1febb1-9993-4634-80c9-c0551370b05e-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:11 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:01:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Flow 'volume_create_manager' (c18858f2-330d-4043-9835-3efeed5447f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbae431d-c171-4b29-bb16-74db9d240728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbae431d-c171-4b29-bb16-74db9d240728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-153550785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97c224d-7b57-4be9-8717-288b117a4737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba27989b8b6a4e1790d82f66e69a2864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:12Z,use_quota=True,user_id='1d2b485566e2426cb87abe0bcf73f0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b437cd46-678a-45c9-9375-a26b540bf8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b437cd46-678a-45c9-9375-a26b540bf8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71837496-1f6e-4029-a283-64621bdf1272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71837496-1f6e-4029-a283-64621bdf1272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97c224d-7b57-4be9-8717-288b117a4737', 'volume_name': 'volume-a97c224d-7b57-4be9-8717-288b117a4737', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41660fde-b755-4264-906b-b7f2ddb89167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41660fde-b755-4264-906b-b7f2ddb89167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cd2c46-7cde-4679-a560-cce45043f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Volume a97c224d-7b57-4be9-8717-288b117a4737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97c224d-7b57-4be9-8717-288b117a4737', 'volume_size': 1} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-153550785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97c224d-7b57-4be9-8717-288b117a4737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba27989b8b6a4e1790d82f66e69a2864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:12Z,use_quota=True,user_id='1d2b485566e2426cb87abe0bcf73f0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Creating volume a97c224d-7b57-4be9-8717-288b117a4737 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:01:12 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:12 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 1073741824 Sep 08 14:01:12 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Flow 'volume_create_manager' (2b3212e5-888a-4ab0-9b95-1c07a67ad1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7067065-934b-4129-95c2-3480a3d32fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7067065-934b-4129-95c2-3480a3d32fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-664520556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e3fa71-e291-444d-b03c-4be5e7c79902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba27989b8b6a4e1790d82f66e69a2864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:12Z,use_quota=True,user_id='1d2b485566e2426cb87abe0bcf73f0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43c3fcb-083f-4e48-93ac-0ee96d69c195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43c3fcb-083f-4e48-93ac-0ee96d69c195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78964fbb-94b6-43f7-a46f-062ed86b9da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78964fbb-94b6-43f7-a46f-062ed86b9da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e3fa71-e291-444d-b03c-4be5e7c79902', 'volume_name': 'volume-41e3fa71-e291-444d-b03c-4be5e7c79902', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc91e823-a34e-48f0-afaf-1c89f6f6ee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc91e823-a34e-48f0-afaf-1c89f6f6ee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd933b8b-d6d4-4ab1-859c-55b43953dea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Volume 41e3fa71-e291-444d-b03c-4be5e7c79902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e3fa71-e291-444d-b03c-4be5e7c79902', 'volume_size': 1} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:12 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 1073741824" returned: 0 in 0.753s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:12 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 Sep 08 14:01:12 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:13 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737" returned: 0 in 0.304s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-664520556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e3fa71-e291-444d-b03c-4be5e7c79902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba27989b8b6a4e1790d82f66e69a2864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:12Z,use_quota=True,user_id='1d2b485566e2426cb87abe0bcf73f0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Creating volume 41e3fa71-e291-444d-b03c-4be5e7c79902 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:01:13 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cd2c46-7cde-4679-a560-cce45043f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97c224d-7b57-4be9-8717-288b117a4737', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b570aa2e-ac45-48df-b608-77fbf71688d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:13 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 1073741824 Sep 08 14:01:13 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:13 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Volume volume-a97c224d-7b57-4be9-8717-288b117a4737 (a97c224d-7b57-4be9-8717-288b117a4737): created successfully Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b570aa2e-ac45-48df-b608-77fbf71688d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Flow 'volume_create_manager' (c18858f2-330d-4043-9835-3efeed5447f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7cc295fe-5fd1-434f-9eed-8fbbb2f44e62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Created volume successfully. Sep 08 14:01:13 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 1073741824" returned: 0 in 0.705s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:14 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 Sep 08 14:01:14 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:14 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902" returned: 0 in 0.281s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:01:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd933b8b-d6d4-4ab1-859c-55b43953dea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e3fa71-e291-444d-b03c-4be5e7c79902', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093ad568-2f00-4e94-b785-b102c439270b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:14 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Volume volume-41e3fa71-e291-444d-b03c-4be5e7c79902 (41e3fa71-e291-444d-b03c-4be5e7c79902): created successfully Sep 08 14:01:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093ad568-2f00-4e94-b785-b102c439270b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Flow 'volume_create_manager' (2b3212e5-888a-4ab0-9b95-1c07a67ad1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:14 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f429fcc1-4d8b-4b29-b310-47a6d849127b tempest-TestServerVolumeAttachmentScenario-145871882 None] Created volume successfully. Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Flow 'volume_create_manager' (4fbabb9c-de92-4aa6-bedd-6eda28c62873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad10cfa-2de5-4abc-bd98-f9336b349513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad10cfa-2de5-4abc-bd98-f9336b349513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-483812252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029b6261abe1483596d5ddd89531578d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40b97d13-d587-42d3-9561-a06c4cf26cf7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:17Z,use_quota=True,user_id='b8b7af3fbe634f8e86e639da528dc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7391083-3be2-4d02-af16-5d9a92989aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7391083-3be2-4d02-af16-5d9a92989aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91dea84-e881-4a6d-8201-29f2b689bea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91dea84-e881-4a6d-8201-29f2b689bea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a', 'volume_name': 'volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a', 'volume_size': 1, 'snapshot_id': '40b97d13-d587-42d3-9561-a06c4cf26cf7'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b441466f-6b29-413d-abea-8a233a4a320f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b441466f-6b29-413d-abea-8a233a4a320f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0dea5f0-d4d8-413f-9aef-7c24b1154b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:17 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Volume 6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a', 'volume_size': 1, 'snapshot_id': '40b97d13-d587-42d3-9561-a06c4cf26cf7'} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-quobyte-40b97d13-d587-42d3-9561-a06c4cf26cf7-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-40b97d13-d587-42d3-9561-a06c4cf26cf7-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Creating volume 6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a from snapshot 40b97d13-d587-42d3-9561-a06c4cf26cf7 {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-quobyte-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] snapshot: 40b97d13-d587-42d3-9561-a06c4cf26cf7, volume: 6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479f55f-324b-4938-bcb2-014d77ff44aa]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:17 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 Sep 08 14:01:17 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:18 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7" returned: 0 in 0.548s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c30255c-1645-49a8-ae78-1d30af12cef6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:18 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 Sep 08 14:01:18 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:18 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" returned: 0 in 0.514s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 14:01:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:18 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a Sep 08 14:01:18 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Flow 'volume_create_manager' (5a62c38e-a024-444f-8b75-47975a9b155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09cc665-071d-43ee-b09f-65617b88b930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09cc665-071d-43ee-b09f-65617b88b930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-638938953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16276e39-3b89-4266-b4f0-01673ecba76c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ecba776e37248a3aed807b158b5dcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:20Z,use_quota=True,user_id='7c77da13e672473795fdcd069511416c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be06635-157e-473e-8943-7c2eedc3196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be06635-157e-473e-8943-7c2eedc3196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f19d32b-200a-4e13-9109-b6946ebcf61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f19d32b-200a-4e13-9109-b6946ebcf61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16276e39-3b89-4266-b4f0-01673ecba76c', 'volume_name': 'volume-16276e39-3b89-4266-b4f0-01673ecba76c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77193ae-9562-4591-b8a2-dfb28a149be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77193ae-9562-4591-b8a2-dfb28a149be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21417b2e-8bed-439d-895e-aac8e9a6113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Volume 16276e39-3b89-4266-b4f0-01673ecba76c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16276e39-3b89-4266-b4f0-01673ecba76c', 'volume_size': 1} Sep 08 14:01:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" returned: 0 in 6.664s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:25 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:01:25 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Converted 1024.00 MB image at 153.64 MB/s Sep 08 14:01:25 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a is being set with open permissions: ugo+rw Sep 08 14:01:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:25 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a Sep 08 14:01:25 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:25 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" returned: 0 in 0.504s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" released by "_copy_volume_from_snapshot" :: held 8.373s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-40b97d13-d587-42d3-9561-a06c4cf26cf7-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" released by "_create_volume_from_snapshot" :: held 8.469s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.501s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.077s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-638938953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16276e39-3b89-4266-b4f0-01673ecba76c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ecba776e37248a3aed807b158b5dcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:20Z,use_quota=True,user_id='7c77da13e672473795fdcd069511416c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Creating volume 16276e39-3b89-4266-b4f0-01673ecba76c {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:01:26 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:26 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c 1073741824 Sep 08 14:01:26 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0dea5f0-d4d8-413f-9aef-7c24b1154b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a', 'volume_size': 1, 'snapshot_id': '40b97d13-d587-42d3-9561-a06c4cf26cf7'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1825af26-bd9f-429d-97e4-a2e36567d7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Volume volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a (6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a): created successfully Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1825af26-bd9f-429d-97e4-a2e36567d7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Flow 'volume_create_manager' (4fbabb9c-de92-4aa6-bedd-6eda28c62873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e2cdfea5-5c08-486f-a79a-8a8404cc8885 tempest-TestStampPattern-1484049102 None] Created volume successfully. Sep 08 14:01:26 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c 1073741824" returned: 0 in 0.834s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:27 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c Sep 08 14:01:27 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:27 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c" returned: 0 in 0.319s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:01:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21417b2e-8bed-439d-895e-aac8e9a6113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16276e39-3b89-4266-b4f0-01673ecba76c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d564d373-2daa-4658-a0f4-75130ec7212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:27 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Volume volume-16276e39-3b89-4266-b4f0-01673ecba76c (16276e39-3b89-4266-b4f0-01673ecba76c): created successfully Sep 08 14:01:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d564d373-2daa-4658-a0f4-75130ec7212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Flow 'volume_create_manager' (5a62c38e-a024-444f-8b75-47975a9b155c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-894ece2b-cdd0-44db-b889-7b5ff5e597f3 tempest-VolumesListTestJSON-1379338280 None] Created volume successfully. Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Flow 'volume_create_manager' (e3a8f6d7-1d02-4d86-8d20-afd09eaf8156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad5fdfe-3b14-48c9-81e4-cf2667298ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad5fdfe-3b14-48c9-81e4-cf2667298ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1486953765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3075bb8b-3e46-49e9-aa26-cd5831ef38e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ecba776e37248a3aed807b158b5dcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:29Z,use_quota=True,user_id='7c77da13e672473795fdcd069511416c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f59154-4668-4fd0-82c3-e1e9be61cb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f59154-4668-4fd0-82c3-e1e9be61cb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f951033b-a6e7-43d2-8ec8-a7e366a9fd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f951033b-a6e7-43d2-8ec8-a7e366a9fd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3075bb8b-3e46-49e9-aa26-cd5831ef38e8', 'volume_name': 'volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c44bc29-6f0f-4d74-8547-4688f5f8ee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c44bc29-6f0f-4d74-8547-4688f5f8ee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb609952-6525-4b14-881e-0b1e5d32e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:28 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Volume 3075bb8b-3e46-49e9-aa26-cd5831ef38e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8', 'volume_size': 1} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1486953765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3075bb8b-3e46-49e9-aa26-cd5831ef38e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ecba776e37248a3aed807b158b5dcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:29Z,use_quota=True,user_id='7c77da13e672473795fdcd069511416c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Creating volume 3075bb8b-3e46-49e9-aa26-cd5831ef38e8 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:01:28 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:01:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:29 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 1073741824 Sep 08 14:01:29 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:30 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 1073741824" returned: 0 in 1.143s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:30 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 Sep 08 14:01:30 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:30 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8" returned: 0 in 0.396s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb609952-6525-4b14-881e-0b1e5d32e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6d8cbc-1571-4dee-8ee3-b571820b3b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:30 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Volume volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 (3075bb8b-3e46-49e9-aa26-cd5831ef38e8): created successfully Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6d8cbc-1571-4dee-8ee3-b571820b3b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Flow 'volume_create_manager' (e3a8f6d7-1d02-4d86-8d20-afd09eaf8156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5e982498-342a-4992-b7ae-dc7a94032f7c tempest-VolumesListTestJSON-1379338280 None] Created volume successfully. Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Flow 'volume_create_manager' (5973a2ca-7026-4da0-89a0-bc5424416e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c50f2e-7e31-4049-93f5-dee3c8df29f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c50f2e-7e31-4049-93f5-dee3c8df29f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827938822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7668918a-8c3f-4040-ae38-f27f3df9145a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ecba776e37248a3aed807b158b5dcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:32Z,use_quota=True,user_id='7c77da13e672473795fdcd069511416c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af55b5f-0ef9-4de5-b447-41cb676e1702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af55b5f-0ef9-4de5-b447-41cb676e1702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21aea832-455b-4c27-bf5e-f5b4b45dcf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21aea832-455b-4c27-bf5e-f5b4b45dcf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7668918a-8c3f-4040-ae38-f27f3df9145a', 'volume_name': 'volume-7668918a-8c3f-4040-ae38-f27f3df9145a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fad374-c32a-47f9-b60b-80ad7508d381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fad374-c32a-47f9-b60b-80ad7508d381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03883bf9-7998-47eb-abcd-da3a770cc53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:32 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Volume 7668918a-8c3f-4040-ae38-f27f3df9145a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7668918a-8c3f-4040-ae38-f27f3df9145a', 'volume_size': 1} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827938822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7668918a-8c3f-4040-ae38-f27f3df9145a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ecba776e37248a3aed807b158b5dcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:32Z,use_quota=True,user_id='7c77da13e672473795fdcd069511416c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Creating volume 7668918a-8c3f-4040-ae38-f27f3df9145a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:01:32 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:32 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a 1073741824 Sep 08 14:01:32 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:32 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a 1073741824" returned: 0 in 0.495s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:33 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a Sep 08 14:01:33 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:33 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a" returned: 0 in 0.250s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:01:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03883bf9-7998-47eb-abcd-da3a770cc53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7668918a-8c3f-4040-ae38-f27f3df9145a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235d3ed4-f243-4f31-9fe4-46441cd26cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:33 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Volume volume-7668918a-8c3f-4040-ae38-f27f3df9145a (7668918a-8c3f-4040-ae38-f27f3df9145a): created successfully Sep 08 14:01:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235d3ed4-f243-4f31-9fe4-46441cd26cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Flow 'volume_create_manager' (5973a2ca-7026-4da0-89a0-bc5424416e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:33 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b3356d3b-619e-4a94-a0aa-d73fca403af7 tempest-VolumesListTestJSON-1379338280 None] Created volume successfully. Sep 08 14:01:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "cinder-7668918a-8c3f-4040-ae38-f27f3df9145a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-7668918a-8c3f-4040-ae38-f27f3df9145a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "cinder-quobyte-7668918a-8c3f-4040-ae38-f27f3df9145a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-quobyte-7668918a-8c3f-4040-ae38-f27f3df9145a" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:37 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d0a299-0116-41fa-8c12-ffdf4cba6415]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:37 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a Sep 08 14:01:37 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:37 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a" returned: 0 in 0.400s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:37 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a Sep 08 14:01:37 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:38 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7668918a-8c3f-4040-ae38-f27f3df9145a" returned: 0 in 0.271s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-quobyte-7668918a-8c3f-4040-ae38-f27f3df9145a" released by "delete_volume" :: held 0.722s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Created reservations ['1e083ff9-6265-44a6-b9e2-e65ff1ffd7ad', '41e67435-9ca6-448f-87fc-4c5485bf90ce', '6446ad6f-5630-4b84-a394-10f08a963aa0', 'd3f76c82-44b7-4609-b47c-94bb10febf85'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:38 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:01:38 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:38 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "cinder-3075bb8b-3e46-49e9-aa26-cd5831ef38e8-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.342s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:01:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Deleted volume successfully. Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-3075bb8b-3e46-49e9-aa26-cd5831ef38e8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-95fa0df1-feb4-4c68-9442-09404da93273 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-7668918a-8c3f-4040-ae38-f27f3df9145a-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "cinder-quobyte-3075bb8b-3e46-49e9-aa26-cd5831ef38e8" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-quobyte-3075bb8b-3e46-49e9-aa26-cd5831ef38e8" acquired by "delete_volume" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[045c9150-190b-496c-b7ca-72e56cdef531]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:39 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 Sep 08 14:01:39 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:39 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8" returned: 0 in 0.437s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:39 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8 Sep 08 14:01:39 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:39 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3075bb8b-3e46-49e9-aa26-cd5831ef38e8" returned: 0 in 0.327s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-quobyte-3075bb8b-3e46-49e9-aa26-cd5831ef38e8" released by "delete_volume" :: held 0.816s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Created reservations ['0fa74654-3ed5-4201-9f93-ee7e60ddce1b', 'a537ee68-4304-4a0c-ab35-0bbbe14f75ca', '1b77b2f0-d946-49f7-8048-4347a53c61d3', '9888645f-560c-460f-8f8f-5cf7b2f3b020'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:40 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:01:40 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "cinder-16276e39-3b89-4266-b4f0-01673ecba76c-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-16276e39-3b89-4266-b4f0-01673ecba76c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "cinder-quobyte-16276e39-3b89-4266-b4f0-01673ecba76c" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:01:40 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.475s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:01:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Deleted volume successfully. Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-quobyte-16276e39-3b89-4266-b4f0-01673ecba76c" acquired by "delete_volume" :: waited 0.048s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4869648e-fc6e-4e5e-8a4c-f4efeaadcad7]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-81110f74-4517-468a-a2ac-d61f9adae9b4 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-3075bb8b-3e46-49e9-aa26-cd5831ef38e8-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:40 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c Sep 08 14:01:40 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:40 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c" returned: 0 in 0.413s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:40 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c Sep 08 14:01:40 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:41 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16276e39-3b89-4266-b4f0-01673ecba76c" returned: 0 in 0.258s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-quobyte-16276e39-3b89-4266-b4f0-01673ecba76c" released by "delete_volume" :: held 0.722s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Created reservations ['11903726-020c-4a84-bbe9-322cfd7e576b', '8c25da16-9adb-420e-af5b-43d962012cec', '8b3d1a75-fbf6-4832-aea2-9ebb5937fa6c', '76b0f30f-3283-4d17-b0cd-4ca349abaf41'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:41 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:01:41 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:41 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.280s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:01:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Deleted volume successfully. Sep 08 14:01:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-fe47a659-36a8-45ef-8e92-b5ca64cc5169 tempest-VolumesListTestJSON-1379338280 None] Lock "cinder-16276e39-3b89-4266-b4f0-01673ecba76c-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=48,cinder:UPDATE=57,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=48,cinder:UPDATE=53,cinder:INSERT=9,cinder:DELETE=6 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Flow 'volume_create_manager' (0a469c34-d7ae-4f84-9a1b-c5d606308fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9a1c82-ca9d-4610-931c-076213724889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9a1c82-ca9d-4610-931c-076213724889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-883947517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a0de20-108a-4c03-b7e8-4bfeaba7b745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5cf20ee43c479584e69eb67eeb36c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:45Z,use_quota=True,user_id='d299b176e40a490e95c2d6b86706f4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d39866-64a6-4b95-98f0-b2025dc4dc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d39866-64a6-4b95-98f0-b2025dc4dc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350f5233-740e-48d9-8a7c-6a95cff73f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350f5233-740e-48d9-8a7c-6a95cff73f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a0de20-108a-4c03-b7e8-4bfeaba7b745', 'volume_name': 'volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bbb13e-63a3-4e1a-837a-bf782e431307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bbb13e-63a3-4e1a-837a-bf782e431307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f540039-dea1-4159-a0bc-51f3ca3cd889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:45 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Volume b7a0de20-108a-4c03-b7e8-4bfeaba7b745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745', 'volume_size': 1} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-883947517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a0de20-108a-4c03-b7e8-4bfeaba7b745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5cf20ee43c479584e69eb67eeb36c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:01:45Z,use_quota=True,user_id='d299b176e40a490e95c2d6b86706f4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Creating volume b7a0de20-108a-4c03-b7e8-4bfeaba7b745 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:01:45 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:45 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 1073741824 Sep 08 14:01:45 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:45 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 1073741824" returned: 0 in 0.390s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:01:45 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 Sep 08 14:01:45 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:01:45 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745" returned: 0 in 0.255s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f540039-dea1-4159-a0bc-51f3ca3cd889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1b44a2-c8cf-45db-b683-bec5b1ce6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:01:45 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Volume volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 (b7a0de20-108a-4c03-b7e8-4bfeaba7b745): created successfully Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1b44a2-c8cf-45db-b683-bec5b1ce6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:01:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Flow 'volume_create_manager' (0a469c34-d7ae-4f84-9a1b-c5d606308fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:01:46 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-93437e67-87c4-4e9c-a4ca-93593675252e tempest-VolumesNegativeTest-914053049 None] Created volume successfully. Sep 08 14:01:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-e8059a67-0628-47f5-9b1d-52bba8c925b4 req-6e7c41fc-0ad0-46a6-9929-23e4ca5654d9 tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-e8059a67-0628-47f5-9b1d-52bba8c925b4 req-6e7c41fc-0ad0-46a6-9929-23e4ca5654d9 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-e8059a67-0628-47f5-9b1d-52bba8c925b4 req-6e7c41fc-0ad0-46a6-9929-23e4ca5654d9 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-e8059a67-0628-47f5-9b1d-52bba8c925b4 req-6e7c41fc-0ad0-46a6-9929-23e4ca5654d9 tempest-TestServerVolumeAttachmentScenario-145871882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-a97c224d-7b57-4be9-8717-288b117a4737', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ede34c7f-9ebe-4926-8cf0-a884763557bf', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 14:01:52 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-e8059a67-0628-47f5-9b1d-52bba8c925b4 req-6e7c41fc-0ad0-46a6-9929-23e4ca5654d9 tempest-TestServerVolumeAttachmentScenario-145871882 None] attachment_update completed successfully. Sep 08 14:01:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-bb7b3ee8-3dcc-4e55-acac-3d389b17722a req-faa4bd1d-7048-4666-9b19-8d81cfe82fc2 tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:01:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-bb7b3ee8-3dcc-4e55-acac-3d389b17722a req-faa4bd1d-7048-4666-9b19-8d81cfe82fc2 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:01:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-bb7b3ee8-3dcc-4e55-acac-3d389b17722a req-faa4bd1d-7048-4666-9b19-8d81cfe82fc2 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:01:57 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-bb7b3ee8-3dcc-4e55-acac-3d389b17722a req-faa4bd1d-7048-4666-9b19-8d81cfe82fc2 tempest-TestServerVolumeAttachmentScenario-145871882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-41e3fa71-e291-444d-b03c-4be5e7c79902', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3ec9cb8-9118-4f52-87ea-7965239e31f0', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 14:01:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-bb7b3ee8-3dcc-4e55-acac-3d389b17722a req-faa4bd1d-7048-4666-9b19-8d81cfe82fc2 tempest-TestServerVolumeAttachmentScenario-145871882 None] attachment_update completed successfully. Sep 08 14:01:59 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-1ae88420-ebbb-4d8a-a429-efd2c0af0228 req-236b2331-e6fa-45f0-bf57-d1217e28d9c4 tempest-TestServerVolumeAttachmentScenario-145871882 None] Terminate volume connection completed successfully. Sep 08 14:01:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-1ae88420-ebbb-4d8a-a429-efd2c0af0228 req-236b2331-e6fa-45f0-bf57-d1217e28d9c4 tempest-TestServerVolumeAttachmentScenario-145871882 None] Deleting attachment d3ec9cb8-9118-4f52-87ea-7965239e31f0. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 14:02:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-c6ce2e60-82d3-4997-82f9-09ae6bf28f74 req-36a8db84-1c74-4813-ad07-012e0ca5bd48 tempest-TestServerVolumeAttachmentScenario-145871882 None] Terminate volume connection completed successfully. Sep 08 14:02:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-c6ce2e60-82d3-4997-82f9-09ae6bf28f74 req-36a8db84-1c74-4813-ad07-012e0ca5bd48 tempest-TestServerVolumeAttachmentScenario-145871882 None] Deleting attachment ede34c7f-9ebe-4926-8cf0-a884763557bf. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:03 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:03 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:03 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.422s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Acquiring lock "cinder-b7a0de20-108a-4c03-b7e8-4bfeaba7b745-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Lock "cinder-b7a0de20-108a-4c03-b7e8-4bfeaba7b745-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Acquiring lock "cinder-quobyte-b7a0de20-108a-4c03-b7e8-4bfeaba7b745" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Lock "cinder-quobyte-b7a0de20-108a-4c03-b7e8-4bfeaba7b745" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff87a46-8793-454b-acd0-e2298f10234d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:03 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 Sep 08 14:02:03 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:04 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:04 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745 Sep 08 14:02:04 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:04 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b7a0de20-108a-4c03-b7e8-4bfeaba7b745" returned: 0 in 0.255s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Lock "cinder-quobyte-b7a0de20-108a-4c03-b7e8-4bfeaba7b745" released by "delete_volume" :: held 0.686s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Created reservations ['6f25a34c-e064-493b-a012-9bcf170b7804', '984cab8c-eca9-465e-9262-222c49b32d8e', '46357f94-6819-4916-975f-10595ff35e49', '89c2ca3a-6eed-42f0-ab36-71897ea7920a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:04 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:04 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:04 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.256s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:04 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Deleted volume successfully. Sep 08 14:02:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d12325ca-ba4f-4ac1-85f3-28ac1a6136df tempest-VolumesNegativeTest-914053049 None] Lock "cinder-b7a0de20-108a-4c03-b7e8-4bfeaba7b745-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "cinder-41e3fa71-e291-444d-b03c-4be5e7c79902-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "cinder-41e3fa71-e291-444d-b03c-4be5e7c79902-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "cinder-quobyte-41e3fa71-e291-444d-b03c-4be5e7c79902" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "cinder-quobyte-41e3fa71-e291-444d-b03c-4be5e7c79902" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:05 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9280383-12d7-4da4-a170-235ba59714e9]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:05 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 Sep 08 14:02:05 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:06 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902" returned: 0 in 0.391s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:06 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902 Sep 08 14:02:06 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:06 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-41e3fa71-e291-444d-b03c-4be5e7c79902" returned: 0 in 0.248s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "cinder-quobyte-41e3fa71-e291-444d-b03c-4be5e7c79902" released by "delete_volume" :: held 0.683s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Created reservations ['aeaa44d3-b222-4147-9e1a-d4c03607a37b', '43797f93-c5bd-4b7e-8c13-130ce8a18760', '803b9560-c94e-44cb-b2fd-6e97e8a35dd6', '2bb27009-7e39-499a-9a83-076d6109b4ec'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:06 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:06 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:06 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.265s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "cinder-a97c224d-7b57-4be9-8717-288b117a4737-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:06 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Deleted volume successfully. Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "cinder-a97c224d-7b57-4be9-8717-288b117a4737-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-af267a45-cb49-44a3-a5d2-497d8f40053c tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "cinder-41e3fa71-e291-444d-b03c-4be5e7c79902-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "cinder-quobyte-a97c224d-7b57-4be9-8717-288b117a4737" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "cinder-quobyte-a97c224d-7b57-4be9-8717-288b117a4737" acquired by "delete_volume" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf10dfcc-9fcb-47e4-8f78-711211950ae6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:07 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 Sep 08 14:02:07 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:07 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737" returned: 0 in 0.383s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:07 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737 Sep 08 14:02:07 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:07 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-a97c224d-7b57-4be9-8717-288b117a4737" returned: 0 in 0.274s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "cinder-quobyte-a97c224d-7b57-4be9-8717-288b117a4737" released by "delete_volume" :: held 0.701s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Created reservations ['73b0e8f4-35a1-448f-a499-a35966325409', '90267840-8321-4209-943b-c10eb9f4c00c', '4e1ecbd2-2143-4d4f-8a41-e9578e5c83e9', 'a8d91e9f-e08e-47e2-98c3-145c2a7b3018'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:07 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:07 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:08 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.304s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:08 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Deleted volume successfully. Sep 08 14:02:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a056240b-625e-4789-8aef-aa361b858c62 tempest-TestServerVolumeAttachmentScenario-145871882 None] Lock "cinder-a97c224d-7b57-4be9-8717-288b117a4737-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ddef4218-256c-4017-9cd5-4493fea85a1d req-33a1b736-28a3-462e-a788-0cb1e0bbb500 tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ddef4218-256c-4017-9cd5-4493fea85a1d req-33a1b736-28a3-462e-a788-0cb1e0bbb500 tempest-TestStampPattern-1484049102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [req-ddef4218-256c-4017-9cd5-4493fea85a1d req-33a1b736-28a3-462e-a788-0cb1e0bbb500 tempest-TestStampPattern-1484049102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-ddef4218-256c-4017-9cd5-4493fea85a1d req-33a1b736-28a3-462e-a788-0cb1e0bbb500 tempest-TestStampPattern-1484049102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7', 'name': 'volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '977a6174-e236-4e7c-98cc-558d60fa96f5', 'enforce_multipath': True} {{(pid=87262) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 14:02:14 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-ddef4218-256c-4017-9cd5-4493fea85a1d req-33a1b736-28a3-462e-a788-0cb1e0bbb500 tempest-TestStampPattern-1484049102 None] attachment_update completed successfully. Sep 08 14:02:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [req-aa47590b-cdd4-4f66-bf51-792a443b2264 req-7f56c584-b563-4ef9-974d-c9916ebf5060 tempest-TestStampPattern-1484049102 None] Terminate volume connection completed successfully. Sep 08 14:02:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [req-aa47590b-cdd4-4f66-bf51-792a443b2264 req-7f56c584-b563-4ef9-974d-c9916ebf5060 tempest-TestStampPattern-1484049102 None] Deleting attachment 977a6174-e236-4e7c-98cc-558d60fa96f5. {{(pid=87262) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 14:02:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Lock "cinder-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-quobyte-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdf971f-63fd-48bd-94b9-e184adc3b8c2]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:22 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a Sep 08 14:02:22 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:23 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" returned: 0 in 0.395s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:23 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a Sep 08 14:02:23 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:23 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (ccd5cc24-c01f-4591-b6ff-7272e19c63b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c26d239-cf89-4e34-b883-f9b50cf251d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" returned: 0 in 0.409s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c26d239-cf89-4e34-b883-f9b50cf251d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1618879812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72897d31-8b58-4c02-b992-e0b285f4bab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:23Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a25cd41-1b54-41bf-990f-036b86b26f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a25cd41-1b54-41bf-990f-036b86b26f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bccbadc-a722-472a-88cb-c0d3a107f5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bccbadc-a722-472a-88cb-c0d3a107f5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72897d31-8b58-4c02-b992-e0b285f4bab6', 'volume_name': 'volume-72897d31-8b58-4c02-b992-e0b285f4bab6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf0f358-a061-46b3-9516-36f0cb7d12aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf0f358-a061-46b3-9516-36f0cb7d12aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2490697-50be-4e52-9103-f21ca5eab6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:23 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Volume 72897d31-8b58-4c02-b992-e0b285f4bab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72897d31-8b58-4c02-b992-e0b285f4bab6', 'volume_size': 1} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1618879812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72897d31-8b58-4c02-b992-e0b285f4bab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:23Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Creating volume 72897d31-8b58-4c02-b992-e0b285f4bab6 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:02:23 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a" released by "delete_volume" :: held 0.939s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:23 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 1073741824 Sep 08 14:02:23 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Created reservations ['b4bb9e0f-3cc8-4839-b7a1-617dd6f0ac1d', '562ac451-4c4a-485c-a9aa-7573b05c7319', '5a06c354-d84b-407f-97d0-354a1c6e2821', 'afd53adb-a9c2-43ce-94aa-1da42a3c9af1'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:23 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:23 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (ac59165e-adb6-41bc-ad90-1a5dbdd8f803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bb8d0d-1371-49a1-9706-a5d79bffac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bb8d0d-1371-49a1-9706-a5d79bffac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1849426887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c08c30-8979-4a04-a40f-e064b95020fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:24Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8450a42-8996-45b3-829d-d37c2b64e5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8450a42-8996-45b3-829d-d37c2b64e5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295937a1-9be0-4725-af28-26ff1a9260ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295937a1-9be0-4725-af28-26ff1a9260ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c08c30-8979-4a04-a40f-e064b95020fa', 'volume_name': 'volume-19c08c30-8979-4a04-a40f-e064b95020fa', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7d140-7377-4f67-a188-e4aaa1544c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7d140-7377-4f67-a188-e4aaa1544c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c221f28d-436b-4ace-9e8a-cbbeb3fe5fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Volume 19c08c30-8979-4a04-a40f-e064b95020fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c08c30-8979-4a04-a40f-e064b95020fa', 'volume_size': 1} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:24 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.465s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Deleted volume successfully. Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-40b97d13-d587-42d3-9561-a06c4cf26cf7-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-97c55157-99c9-40c3-98ba-c13845059252 tempest-TestStampPattern-1484049102 None] Lock "cinder-6d3e9e8a-c2db-4ecf-8a05-e1ff7c595a6a-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Lock "cinder-40b97d13-d587-42d3-9561-a06c4cf26cf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-quobyte-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-quobyte-40b97d13-d587-42d3-9561-a06c4cf26cf7" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-40b97d13-d587-42d3-9561-a06c4cf26cf7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Deleting offline snapshot 40b97d13-d587-42d3-9561-a06c4cf26cf7 of volume 2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] snapshot_file for this snap is: volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:02:24 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 1073741824" returned: 0 in 0.865s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b43326c-5bc1-4ff2-9b4e-05654647e68d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:24 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 Sep 08 14:02:24 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (bc4611fc-c290-4d68-a0e0-e9113dc78280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:24 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 Sep 08 14:02:24 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4af300-b762-4aa6-a01b-13d4861a69e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4af300-b762-4aa6-a01b-13d4861a69e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-375600695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6cfa5d-5e48-41f6-a811-b87329a3e472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:25Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2e3378-0b56-4725-8f79-1ab2238eae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2e3378-0b56-4725-8f79-1ab2238eae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e525fb-3758-4cd1-9db0-64b9899d9c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e525fb-3758-4cd1-9db0-64b9899d9c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6cfa5d-5e48-41f6-a811-b87329a3e472', 'volume_name': 'volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4007315-d4b6-46d1-87ca-4ccf1aa287b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4007315-d4b6-46d1-87ca-4ccf1aa287b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81366fec-5370-4d57-8262-a2a843845abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Volume 3c6cfa5d-5e48-41f6-a811-b87329a3e472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472', 'volume_size': 1} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:24 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6" returned: 0 in 0.310s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1849426887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c08c30-8979-4a04-a40f-e064b95020fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:24Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Creating volume 19c08c30-8979-4a04-a40f-e064b95020fa {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:02:24 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:24 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa 1073741824 Sep 08 14:02:24 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2490697-50be-4e52-9103-f21ca5eab6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72897d31-8b58-4c02-b992-e0b285f4bab6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1fd4db-f923-42b5-90ee-081b0c4ea700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Volume volume-72897d31-8b58-4c02-b992-e0b285f4bab6 (72897d31-8b58-4c02-b992-e0b285f4bab6): created successfully Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1fd4db-f923-42b5-90ee-081b0c4ea700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (ccd5cc24-c01f-4591-b6ff-7272e19c63b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7e792c93-2a14-4d0a-9de8-72e1ec3e7380 tempest-CreateVolumesFromImageTest-1300586948 None] Created volume successfully. Sep 08 14:02:25 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7" returned: 0 in 0.640s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[216bd313-3d3a-42c4-8df4-742bd19f8cbb]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (32cb6199-4b14-4bea-91b6-027622044a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d66e2f-f9a3-4cef-852d-558822b8aa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d66e2f-f9a3-4cef-852d-558822b8aa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230427999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a02e1ff-dda2-4ead-aa06-8ae64c05af2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:25Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a6aad1-b25f-4e92-878f-6a4be7bac544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a6aad1-b25f-4e92-878f-6a4be7bac544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd758fb-34c2-4021-a4b4-c74c231e0b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd758fb-34c2-4021-a4b4-c74c231e0b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a02e1ff-dda2-4ead-aa06-8ae64c05af2a', 'volume_name': 'volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e898b245-1144-4d18-8b94-9ab4fb0688b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e898b245-1144-4d18-8b94-9ab4fb0688b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec4566-103f-4a6d-9e14-507fe496335d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Volume 2a02e1ff-dda2-4ead-aa06-8ae64c05af2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a', 'volume_size': 1} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:25 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 Sep 08 14:02:25 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:25 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa 1073741824" returned: 0 in 0.644s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:25 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa Sep 08 14:02:25 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (7bad5321-991f-471f-981a-d37640cbcb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba51b87f-83a5-4a7c-adcd-c98ecc4224f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba51b87f-83a5-4a7c-adcd-c98ecc4224f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288587587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2932b039-6ce3-4a8f-a2b6-fe005be5292e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:26Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4991d7c1-d017-4799-8496-a87b567217e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4991d7c1-d017-4799-8496-a87b567217e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d31a86d-5986-4c99-8c6f-63dad33e117a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d31a86d-5986-4c99-8c6f-63dad33e117a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2932b039-6ce3-4a8f-a2b6-fe005be5292e', 'volume_name': 'volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92b736f-1343-443e-9cfa-aa1221273e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92b736f-1343-443e-9cfa-aa1221273e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b76dd39-61e7-4b90-b37a-3c42f417caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Volume 2932b039-6ce3-4a8f-a2b6-fe005be5292e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e', 'volume_size': 1} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:25 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa" returned: 0 in 0.310s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-375600695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6cfa5d-5e48-41f6-a811-b87329a3e472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:25Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Creating volume 3c6cfa5d-5e48-41f6-a811-b87329a3e472 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:02:25 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c221f28d-436b-4ace-9e8a-cbbeb3fe5fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c08c30-8979-4a04-a40f-e064b95020fa', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3059dee3-a6cd-4c76-954f-f135aca8e9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:25 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 1073741824 Sep 08 14:02:25 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Volume volume-19c08c30-8979-4a04-a40f-e064b95020fa (19c08c30-8979-4a04-a40f-e064b95020fa): created successfully Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3059dee3-a6cd-4c76-954f-f135aca8e9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (ac59165e-adb6-41bc-ad90-1a5dbdd8f803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f546285d-ba14-41af-9550-b87ec02fa699 tempest-CreateVolumesFromImageTest-1300586948 None] Created volume successfully. Sep 08 14:02:26 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" returned: 0 in 0.842s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:26 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 Sep 08 14:02:26 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:26 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7" returned: 0 in 0.356s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:26 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 1073741824" returned: 0 in 0.497s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:26 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7 Sep 08 14:02:26 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:26 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 Sep 08 14:02:26 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:26 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39.40b97d13-d587-42d3-9561-a06c4cf26cf7" returned: 0 in 0.303s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-40b97d13-d587-42d3-9561-a06c4cf26cf7" released by "_delete_snapshot" :: held 2.332s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" released by "delete_snapshot" :: held 2.359s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:26 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472" returned: 0 in 0.367s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230427999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a02e1ff-dda2-4ead-aa06-8ae64c05af2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:25Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Creating volume 2a02e1ff-dda2-4ead-aa06-8ae64c05af2a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:02:26 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:26 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a 1073741824 Sep 08 14:02:26 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81366fec-5370-4d57-8262-a2a843845abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71123aaa-042a-460d-ab58-059dc8ca4d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Volume volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 (3c6cfa5d-5e48-41f6-a811-b87329a3e472): created successfully Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71123aaa-042a-460d-ab58-059dc8ca4d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (bc4611fc-c290-4d68-a0e0-e9113dc78280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:26 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Created reservations ['8b5dc5fa-4d63-4a19-963e-f4a675588016', 'd50156e0-7020-4784-918d-78a6b66d308b', 'f1c6d708-71a8-4492-97c3-db2d81510aa3', 'b74d8fe6-5641-428b-a43a-395b1f307b4d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-72d476b1-8281-4bbc-84c4-f995802e7265 tempest-CreateVolumesFromImageTest-1300586948 None] Created volume successfully. Sep 08 14:02:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Delete snapshot completed successfully. Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a8d2bbee-eca5-492a-9012-a42e75fd8927 tempest-TestStampPattern-1484049102 None] Lock "cinder-40b97d13-d587-42d3-9561-a06c4cf26cf7-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:27 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a 1073741824" returned: 0 in 0.430s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:27 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a Sep 08 14:02:27 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:27 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288587587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2932b039-6ce3-4a8f-a2b6-fe005be5292e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3f5025833d4a9a9158b07559177939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:26Z,use_quota=True,user_id='45969bbe8856454ba933f6c76f6cd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Creating volume 2932b039-6ce3-4a8f-a2b6-fe005be5292e {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:02:27 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec4566-103f-4a6d-9e14-507fe496335d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:27 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e 1073741824 Sep 08 14:02:27 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6582e7de-4895-4343-afe0-a8eaf42c6b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:27 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Volume volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a (2a02e1ff-dda2-4ead-aa06-8ae64c05af2a): created successfully Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6582e7de-4895-4343-afe0-a8eaf42c6b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (32cb6199-4b14-4bea-91b6-027622044a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f952ce75-b47e-4989-958f-7ad3d996e916 tempest-CreateVolumesFromImageTest-1300586948 None] Created volume successfully. Sep 08 14:02:28 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e 1073741824" returned: 0 in 0.672s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:28 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e Sep 08 14:02:28 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:28 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e" returned: 0 in 0.306s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b76dd39-61e7-4b90-b37a-3c42f417caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f84a16-c793-4655-bcd6-1a0aed3520b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:28 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Volume volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e (2932b039-6ce3-4a8f-a2b6-fe005be5292e): created successfully Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f84a16-c793-4655-bcd6-1a0aed3520b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Flow 'volume_create_manager' (7bad5321-991f-471f-981a-d37640cbcb49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-af34b776-2af5-407e-8089-8b0f079c7b3a tempest-CreateVolumesFromImageTest-1300586948 None] Created volume successfully. Sep 08 14:02:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-2932b039-6ce3-4a8f-a2b6-fe005be5292e-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-2932b039-6ce3-4a8f-a2b6-fe005be5292e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-quobyte-2932b039-6ce3-4a8f-a2b6-fe005be5292e" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-2932b039-6ce3-4a8f-a2b6-fe005be5292e" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:29 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ed065b-e58d-4c1b-8bf4-dc66b79f9ad8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:29 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e Sep 08 14:02:29 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:30 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e" returned: 0 in 0.524s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:30 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e Sep 08 14:02:30 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:30 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2932b039-6ce3-4a8f-a2b6-fe005be5292e" returned: 0 in 0.337s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-2932b039-6ce3-4a8f-a2b6-fe005be5292e" released by "delete_volume" :: held 0.959s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Created reservations ['d8abfc87-134f-4b0e-a343-f8218133461f', 'f9916d5f-3b92-4363-83dc-be1c4b3d7017', '53c2cdb9-e588-4bc4-acc9-7add7c9ba0b2', 'd92baa10-8390-4ebf-8034-159024191159'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:30 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:30 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:30 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.287s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Deleted volume successfully. Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-98de987d-ae39-4693-bf28-744430509252 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-2932b039-6ce3-4a8f-a2b6-fe005be5292e-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-quobyte-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a" acquired by "delete_volume" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5659f42b-5b4c-4018-831d-cf65b02ad9ca]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:32 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a Sep 08 14:02:32 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:32 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a" returned: 0 in 0.444s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:32 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a Sep 08 14:02:32 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:32 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a" returned: 0 in 0.328s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a" released by "delete_volume" :: held 0.865s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Created reservations ['a99583b3-0829-4c7c-848f-f36574d2ba83', '3d8beaec-94e0-4c89-b7c7-d96aef9d2d5d', '392b2d0f-511b-4804-a0fd-acb2118dea33', '90638d9b-baa4-4be1-b1f1-bfe96e72588b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:32 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:32 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-3c6cfa5d-5e48-41f6-a811-b87329a3e472-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-3c6cfa5d-5e48-41f6-a811-b87329a3e472-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-quobyte-3c6cfa5d-5e48-41f6-a811-b87329a3e472" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-3c6cfa5d-5e48-41f6-a811-b87329a3e472" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[851950dd-c33e-49a0-8b05-82ced5ba74fe]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:33 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.405s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:33 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Deleted volume successfully. Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-46f4e740-0bf5-424d-9eec-58872aeaaaf8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-2a02e1ff-dda2-4ead-aa06-8ae64c05af2a-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:33 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 Sep 08 14:02:33 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:33 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472" returned: 0 in 0.648s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:33 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472 Sep 08 14:02:33 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:34 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3c6cfa5d-5e48-41f6-a811-b87329a3e472" returned: 0 in 0.342s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-3c6cfa5d-5e48-41f6-a811-b87329a3e472" released by "delete_volume" :: held 1.065s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Created reservations ['5ec17c14-0945-4294-b8cf-87edb74cf08b', '13f820b7-b9a5-480a-8727-ca31792308dd', 'c159085d-77fd-4e9d-8c39-42bfa3379d35', '89b09d23-7c0d-411c-b23a-d0ecfd2f2b43'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:34 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:34 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:34 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.262s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Flow 'volume_create_manager' (ac173fa8-7ef0-47d5-b1fb-c3f49e68d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b30e5d4-66e6-4fa9-b3fb-0c7afb42567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Deleted volume successfully. Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b30e5d4-66e6-4fa9-b3fb-0c7afb42567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-360454949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea69b511-570f-413f-98bf-d488e54b145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323c6186e53a45df8ac023a66ed9f1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:35Z,use_quota=True,user_id='23cc32e08bff4048ba8ca5896ef16055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3800d531-512c-4d57-bece-6bf23e79a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3800d531-512c-4d57-bece-6bf23e79a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73172a26-c84d-4ebf-b4f4-49d376d61e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73172a26-c84d-4ebf-b4f4-49d376d61e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea69b511-570f-413f-98bf-d488e54b145c', 'volume_name': 'volume-ea69b511-570f-413f-98bf-d488e54b145c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7200bf47-19a2-4a6b-ad28-747aab8e257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7200bf47-19a2-4a6b-ad28-747aab8e257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91ab17c-3ade-430f-919c-bb3ac298285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:34 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Volume ea69b511-570f-413f-98bf-d488e54b145c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea69b511-570f-413f-98bf-d488e54b145c', 'volume_size': 1} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-360454949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea69b511-570f-413f-98bf-d488e54b145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323c6186e53a45df8ac023a66ed9f1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:35Z,use_quota=True,user_id='23cc32e08bff4048ba8ca5896ef16055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Creating volume ea69b511-570f-413f-98bf-d488e54b145c {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:02:34 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78d8c463-24a6-43c9-8723-1ac25d03ae84 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-3c6cfa5d-5e48-41f6-a811-b87329a3e472-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:34 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c 1073741824 Sep 08 14:02:34 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-2557d9cc-5d83-4c33-abc2-bdafc9b58e39-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Lock "cinder-2557d9cc-5d83-4c33-abc2-bdafc9b58e39-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Acquiring lock "cinder-quobyte-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:35 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c 1073741824" returned: 0 in 0.447s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd97cd85-9421-4521-8fc4-545e763adc3a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:35 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c Sep 08 14:02:35 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-19c08c30-8979-4a04-a40f-e064b95020fa-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:35 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 Sep 08 14:02:35 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-19c08c30-8979-4a04-a40f-e064b95020fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-quobyte-19c08c30-8979-4a04-a40f-e064b95020fa" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-19c08c30-8979-4a04-a40f-e064b95020fa" acquired by "delete_volume" :: waited 0.013s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c399d979-a290-4e5d-a3f4-d405a9941ce2]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:35 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c" returned: 0 in 0.306s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91ab17c-3ade-430f-919c-bb3ac298285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea69b511-570f-413f-98bf-d488e54b145c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b568eda6-7305-4d17-9034-535df7919001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:35 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa Sep 08 14:02:35 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:35 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Volume volume-ea69b511-570f-413f-98bf-d488e54b145c (ea69b511-570f-413f-98bf-d488e54b145c): created successfully Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b568eda6-7305-4d17-9034-535df7919001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Flow 'volume_create_manager' (ac173fa8-7ef0-47d5-b1fb-c3f49e68d5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:35 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" returned: 0 in 0.434s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:35 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-11b3aa79-6781-4f48-8562-7aec03f38c52 tempest-TestImageHashVerification-1774206854 None] Created volume successfully. Sep 08 14:02:35 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39 Sep 08 14:02:35 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:35 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa" returned: 0 in 0.410s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:35 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa Sep 08 14:02:35 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:35 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" returned: 0 in 0.255s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Lock "cinder-quobyte-2557d9cc-5d83-4c33-abc2-bdafc9b58e39" released by "delete_volume" :: held 0.755s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:35 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Created reservations ['9c4eb88f-9b1c-4cd1-bdc5-6864d60dd7a7', '65549bce-ad1e-4dec-b9b7-5c04b7cf2548', '602ee4b3-1db6-4e56-9eef-e244d570b8c3', 'a07a6710-ddcc-4f8d-b428-081ed46733f5'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:36 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:36 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:36 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-19c08c30-8979-4a04-a40f-e064b95020fa" returned: 0 in 0.252s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-19c08c30-8979-4a04-a40f-e064b95020fa" released by "delete_volume" :: held 0.708s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Created reservations ['2423883a-3b0a-49df-8584-66bed8bff51d', '5430fab3-973e-4225-9ec3-3fcd62bc620a', 'ee967d15-a487-4e1f-be01-7f47af65a4fa', 'd50e92f4-89a7-4125-9e89-136d6b656e80'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:36 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:36 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:36 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.277s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Deleted volume successfully. Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-671eedc8-4a6c-40a1-bfd2-6b52ef1aaff5 tempest-TestStampPattern-1484049102 None] Lock "cinder-2557d9cc-5d83-4c33-abc2-bdafc9b58e39-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:36 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Deleted volume successfully. Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-72897d31-8b58-4c02-b992-e0b285f4bab6-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d438b68-e8c8-4efe-8eb3-bf3c0747f716 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-19c08c30-8979-4a04-a40f-e064b95020fa-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-72897d31-8b58-4c02-b992-e0b285f4bab6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "cinder-quobyte-72897d31-8b58-4c02-b992-e0b285f4bab6" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-72897d31-8b58-4c02-b992-e0b285f4bab6" acquired by "delete_volume" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67d94f0-5e89-46fa-8cc4-7e0362d96f5f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:36 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 Sep 08 14:02:36 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:37 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6" returned: 0 in 0.392s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:37 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6 Sep 08 14:02:37 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:37 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-72897d31-8b58-4c02-b992-e0b285f4bab6" returned: 0 in 0.261s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-quobyte-72897d31-8b58-4c02-b992-e0b285f4bab6" released by "delete_volume" :: held 0.715s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Created reservations ['c8b29162-7289-4e20-9e97-e9df1b0a0d95', 'a5a0c87a-f176-4305-a018-ce7826ab4168', 'cfc3f713-de39-4f05-aedc-4b42596dd3b3', 'cfe5c405-722a-4064-af98-f787f3275e47'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:37 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:02:37 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eeed2a-015f-43a7-863e-60e11dad61a1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:37 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.322s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:02:37 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Deleted volume successfully. Sep 08 14:02:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cc70da2d-162c-4188-95c5-e22e5a2cd1d8 tempest-CreateVolumesFromImageTest-1300586948 None] Lock "cinder-72897d31-8b58-4c02-b992-e0b285f4bab6-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:02:37 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c Sep 08 14:02:37 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:38 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c" returned: 0 in 0.437s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e658e39e-0c94-46e9-818c-d4df56e1cf0c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:38 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c Sep 08 14:02:38 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:38 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c" returned: 0 in 0.547s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c /opt/stack/data/cinder/conversion/ea69b511-570f-413f-98bf-d488e54b145c.temp_image.cf21b34a-2333-4503-b811-08ad9cc7c01ctfor0azu.img {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:38 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c /opt/stack/data/cinder/conversion/ea69b511-570f-413f-98bf-d488e54b145c.temp_image.cf21b34a-2333-4503-b811-08ad9cc7c01ctfor0azu.img Sep 08 14:02:38 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:43 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:02:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Flow 'volume_create_manager' (504a0609-64dc-4104-b1b5-770509e1a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6001433-8bf0-40b1-861d-88033288c83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6001433-8bf0-40b1-861d-88033288c83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-330571705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383f458f-7392-4437-8095-e5588ed4ca8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43113e1984bb4464b30974c08a4ea5a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:44Z,use_quota=True,user_id='83a088ff87ca42cfbdde60d67f7b34a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabe2d50-0a65-4835-9a49-c108ffdcbd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabe2d50-0a65-4835-9a49-c108ffdcbd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86977822-4b53-45fa-889b-8178c1924057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:43 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86977822-4b53-45fa-889b-8178c1924057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383f458f-7392-4437-8095-e5588ed4ca8b', 'volume_name': 'volume-383f458f-7392-4437-8095-e5588ed4ca8b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e28ba0f-bc3b-4054-b855-3280899f3a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e28ba0f-bc3b-4054-b855-3280899f3a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94eefdd-e99b-4b50-af05-8bf7e7178576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:44 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Volume 383f458f-7392-4437-8095-e5588ed4ca8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383f458f-7392-4437-8095-e5588ed4ca8b', 'volume_size': 1} Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:02:44 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c /opt/stack/data/cinder/conversion/ea69b511-570f-413f-98bf-d488e54b145c.temp_image.cf21b34a-2333-4503-b811-08ad9cc7c01ctfor0azu.img" returned: 0 in 5.248s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b733d20-bbaa-4760-8ab9-3d66e3004fbe]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:02:44 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c Sep 08 14:02:44 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:02:44 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c" returned: 0 in 0.557s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/conversion/ea69b511-570f-413f-98bf-d488e54b145c.temp_image.cf21b34a-2333-4503-b811-08ad9cc7c01ctfor0azu.img {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:02:44 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Converted 1024.00 MB image at 195.08 MB/s Sep 08 14:02:44 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] cf21b34a-2333-4503-b811-08ad9cc7c01c was raw, no need to convert to raw {{(pid=87262) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=100,cinder:INSERT=27,cinder:UPDATE=100,cinder:DELETE=13 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=123,cinder:DELETE=4,cinder:SELECT=89,cinder:INSERT=24 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (9274d28b-9b8f-4308-932c-6dad94719d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befd5ecf-458c-4767-86e5-df43c5229dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befd5ecf-458c-4767-86e5-df43c5229dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027792418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae4e06f-5fad-408c-a86f-6c1f3f88d39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:52Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d23406-aa67-4615-b256-0adb314354a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d23406-aa67-4615-b256-0adb314354a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4379bbe3-330e-41c4-86ec-30ddea56d8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4379bbe3-330e-41c4-86ec-30ddea56d8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae4e06f-5fad-408c-a86f-6c1f3f88d39c', 'volume_name': 'volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76916b46-9e86-4ad8-9436-9dad8928af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76916b46-9e86-4ad8-9436-9dad8928af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1056918b-ca27-4e38-98ff-cd60203eb9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:02:52 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume bae4e06f-5fad-408c-a86f-6c1f3f88d39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c', 'volume_size': 1} Sep 08 14:02:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:02 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:03 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:03 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:03 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.281s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.935s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Uploaded volume to glance image-id: cf21b34a-2333-4503-b811-08ad9cc7c01c. {{(pid=87262) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.671s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-330571705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383f458f-7392-4437-8095-e5588ed4ca8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43113e1984bb4464b30974c08a4ea5a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:44Z,use_quota=True,user_id='83a088ff87ca42cfbdde60d67f7b34a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Creating volume 383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:03 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:03 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b 1073741824 Sep 08 14:03:03 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:03 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6b121fa6-c0cb-4a28-a319-af56ff351184 tempest-TestImageHashVerification-1774206854 None] Copy volume to image completed successfully. Sep 08 14:03:04 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b 1073741824" returned: 0 in 0.432s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:04 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b Sep 08 14:03:04 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:04 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Acquiring lock "cinder-ea69b511-570f-413f-98bf-d488e54b145c-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.065s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027792418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae4e06f-5fad-408c-a86f-6c1f3f88d39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:02:52Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Creating volume bae4e06f-5fad-408c-a86f-6c1f3f88d39c {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:04 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94eefdd-e99b-4b50-af05-8bf7e7178576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383f458f-7392-4437-8095-e5588ed4ca8b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:04 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c 1073741824 Sep 08 14:03:04 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb5019f-db21-491f-801f-e9203a49f450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Lock "cinder-ea69b511-570f-413f-98bf-d488e54b145c-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:04 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Volume volume-383f458f-7392-4437-8095-e5588ed4ca8b (383f458f-7392-4437-8095-e5588ed4ca8b): created successfully Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb5019f-db21-491f-801f-e9203a49f450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Flow 'volume_create_manager' (504a0609-64dc-4104-b1b5-770509e1a73a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:04 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c2055d77-d60d-4946-baf3-0273d4178115 tempest-VolumeDependencyTests-1301272125 None] Created volume successfully. Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Acquiring lock "cinder-quobyte-ea69b511-570f-413f-98bf-d488e54b145c" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Lock "cinder-quobyte-ea69b511-570f-413f-98bf-d488e54b145c" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b3df8f-6585-4530-9e88-31db9e3d340a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:04 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c Sep 08 14:03:04 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:04 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c 1073741824" returned: 0 in 0.434s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:04 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c Sep 08 14:03:04 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:04 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c" returned: 0 in 0.396s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:05 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c Sep 08 14:03:05 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:05 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" returned: 0 in 0.272s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1056918b-ca27-4e38-98ff-cd60203eb9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a84a73-c72e-43a8-90a2-265fa006493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:05 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c (bae4e06f-5fad-408c-a86f-6c1f3f88d39c): created successfully Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a84a73-c72e-43a8-90a2-265fa006493b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (9274d28b-9b8f-4308-932c-6dad94719d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0df4d435-04db-48d3-adca-d7d2bce0d2e3 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created volume successfully. Sep 08 14:03:05 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ea69b511-570f-413f-98bf-d488e54b145c" returned: 0 in 0.281s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Lock "cinder-quobyte-ea69b511-570f-413f-98bf-d488e54b145c" released by "delete_volume" :: held 0.723s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Created reservations ['cb6071e1-5e84-4861-b8ec-5e56a226d38b', '8458fd16-2a24-42fe-87b1-b56624293bb0', '46287a22-4f83-4789-9782-9cd601c37cd3', 'b7de612a-bb53-4df0-b906-af314bd9c2bd'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Creating offline snapshot 0852e2ac-4a97-4db2-9001-b904dfd5635a of volume 383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a492b80-264f-417c-9cf1-bcfb7df979b6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:05 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:05 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:05 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b Sep 08 14:03:05 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:05 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.279s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Deleted volume successfully. Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d11912e7-80ef-4043-9893-85dc2148c7be tempest-TestImageHashVerification-1774206854 None] Lock "cinder-ea69b511-570f-413f-98bf-d488e54b145c-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:05 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b" returned: 0 in 0.398s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:05 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a 1G Sep 08 14:03:05 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:06 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a 1G" returned: 0 in 0.514s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383f458f-7392-4437-8095-e5588ed4ca8b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:06 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383f458f-7392-4437-8095-e5588ed4ca8b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a Sep 08 14:03:06 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:06 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383f458f-7392-4437-8095-e5588ed4ca8b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a" returned: 0 in 0.324s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:06 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a is being set with open permissions: ugo+rw Sep 08 14:03:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:06 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a Sep 08 14:03:06 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:06 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a" returned: 0 in 0.238s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:06 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.info Sep 08 14:03:06 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:07 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.info" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:07 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.info is being set with open permissions: ugo+rw Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:07 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.info Sep 08 14:03:07 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:07 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.info" returned: 0 in 0.240s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.101s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Creating offline snapshot 7a484e73-6dc0-42dd-b14b-b66c69968442 of volume bae4e06f-5fad-408c-a86f-6c1f3f88d39c {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:03:07 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3ffd1717-9ffe-43ae-9e26-5281e530ead0 tempest-VolumeDependencyTests-1301272125 None] Create snapshot completed successfully Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa3dca-69c2-4ddd-b1bc-ced62e233703]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:07 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c Sep 08 14:03:07 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:07 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" returned: 0 in 0.360s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:07 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 1G Sep 08 14:03:07 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:08 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 1G" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:08 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 Sep 08 14:03:08 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:08 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442" returned: 0 in 0.304s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:08 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 is being set with open permissions: ugo+rw Sep 08 14:03:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:08 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 Sep 08 14:03:08 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:08 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442" returned: 0 in 0.267s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:08 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.info Sep 08 14:03:08 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Flow 'volume_create_manager' (3aa675f9-9bc2-4df9-8bf4-72938d861945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11daad6e-2572-49b0-8551-57a075c5a354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11daad6e-2572-49b0-8551-57a075c5a354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-113736759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43113e1984bb4464b30974c08a4ea5a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0852e2ac-4a97-4db2-9001-b904dfd5635a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:09Z,use_quota=True,user_id='83a088ff87ca42cfbdde60d67f7b34a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558548e4-ee6b-4f51-84cd-d98f9f40dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558548e4-ee6b-4f51-84cd-d98f9f40dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8401df92-fbe4-422a-bbf7-d9d76c20202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8401df92-fbe4-422a-bbf7-d9d76c20202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27', 'volume_name': 'volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27', 'volume_size': 1, 'snapshot_id': '0852e2ac-4a97-4db2-9001-b904dfd5635a'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccd7076-9fa5-43ff-9e35-f08d929a3dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccd7076-9fa5-43ff-9e35-f08d929a3dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ff4ff3-76e2-488b-b577-a84bde714aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:09 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Volume 13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27', 'volume_size': 1, 'snapshot_id': '0852e2ac-4a97-4db2-9001-b904dfd5635a'} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:09 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.info" returned: 0 in 0.368s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:09 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.info is being set with open permissions: ugo+rw Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:09 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.info Sep 08 14:03:09 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:09 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.info" returned: 0 in 0.251s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.312s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-quobyte-0852e2ac-4a97-4db2-9001-b904dfd5635a-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-0852e2ac-4a97-4db2-9001-b904dfd5635a-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Creating volume 13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 from snapshot 0852e2ac-4a97-4db2-9001-b904dfd5635a {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-quobyte-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:09 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a99b64df-63ae-4696-b953-831192e583df tempest-CreateVolumesFromSnapshotTest-1993041431 None] Create snapshot completed successfully Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] snapshot: 0852e2ac-4a97-4db2-9001-b904dfd5635a, volume: 13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6927f92f-51f9-49a2-b83f-ed6450f74acb]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:09 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a Sep 08 14:03:09 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:10 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a" returned: 0 in 0.416s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-383f458f-7392-4437-8095-e5588ed4ca8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a8a0b7-1ed2-47ba-b0e5-20935d760f4d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:10 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b Sep 08 14:03:10 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:10 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b" returned: 0 in 0.391s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 14:03:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:10 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 Sep 08 14:03:10 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (ac327a5c-e817-4fbf-b3db-a44a2049a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ba1d72-4cb4-46dd-85f7-bd61a4c404be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ba1d72-4cb4-46dd-85f7-bd61a4c404be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188024910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e668aea3-fdd7-4817-b6fa-ed23084f96bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:11Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7831e5-f2f2-4bbe-b4df-1ea69d039a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7831e5-f2f2-4bbe-b4df-1ea69d039a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23df573-0eb1-4046-9bc7-973c462a8c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23df573-0eb1-4046-9bc7-973c462a8c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e668aea3-fdd7-4817-b6fa-ed23084f96bb', 'volume_name': 'volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f70c3f-b08a-4a7d-a762-3db7c961589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f70c3f-b08a-4a7d-a762-3db7c961589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f21e6f-d3b2-4477-bdc4-73d64d8af623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:11 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume e668aea3-fdd7-4817-b6fa-ed23084f96bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb', 'volume_size': 1} Sep 08 14:03:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (6be9bea9-d968-4dc8-aebc-0789078cf813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfffe84-844d-4d65-97c2-6b2c4bf0a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfffe84-844d-4d65-97c2-6b2c4bf0a67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-27762533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272d688b-0363-41fb-abf1-72ee549b48cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:12Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f97a5c3-01b4-4606-8272-a1ce3c44205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f97a5c3-01b4-4606-8272-a1ce3c44205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4819d83-bb43-4e40-a9c4-7e26156a399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4819d83-bb43-4e40-a9c4-7e26156a399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272d688b-0363-41fb-abf1-72ee549b48cd', 'volume_name': 'volume-272d688b-0363-41fb-abf1-72ee549b48cd', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664fb051-3361-4d52-b105-8fe423deb086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664fb051-3361-4d52-b105-8fe423deb086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e0e721-8ed5-4188-90cb-d34b3c8354d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume 272d688b-0363-41fb-abf1-72ee549b48cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272d688b-0363-41fb-abf1-72ee549b48cd', 'volume_size': 1} Sep 08 14:03:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (70037219-c79f-4db8-805f-a82b7c469902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bbb57f-2c41-43bf-ba5f-22a16fcc61fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bbb57f-2c41-43bf-ba5f-22a16fcc61fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864826124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3c90d6-e958-410f-8ff0-80bea09e8124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:13Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d0dd78-8d37-4395-8448-a6dfef2edc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d0dd78-8d37-4395-8448-a6dfef2edc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c239b0c1-4544-4355-9a3b-7f26822d8a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c239b0c1-4544-4355-9a3b-7f26822d8a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3c90d6-e958-410f-8ff0-80bea09e8124', 'volume_name': 'volume-9a3c90d6-e958-410f-8ff0-80bea09e8124', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d850152-d7ee-4b68-837c-7140767554b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d850152-d7ee-4b68-837c-7140767554b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64570b0-0634-4609-ad6d-a0fff14fa8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:13 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume 9a3c90d6-e958-410f-8ff0-80bea09e8124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3c90d6-e958-410f-8ff0-80bea09e8124', 'volume_size': 1} Sep 08 14:03:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (6d7f1ea4-e6d2-4865-96df-e572342fb08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1ac4b-eac5-4728-84bd-5ce8be526bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1ac4b-eac5-4728-84bd-5ce8be526bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-526748108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fe8242-63ae-4955-83cd-ab7680c1ccb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:14Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b2153-b82f-470f-8e8e-2c8a4251e695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b2153-b82f-470f-8e8e-2c8a4251e695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1126d949-f7b5-4590-bb5b-8013dca9e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1126d949-f7b5-4590-bb5b-8013dca9e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fe8242-63ae-4955-83cd-ab7680c1ccb9', 'volume_name': 'volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41078140-2fb6-42dc-b102-b4f2c2f9eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41078140-2fb6-42dc-b102-b4f2c2f9eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842e8096-fe78-4b28-916a-18f7f59ef6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:14 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume 87fe8242-63ae-4955-83cd-ab7680c1ccb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9', 'volume_size': 1} Sep 08 14:03:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (4b6021cb-64b2-446e-af3f-79753103020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfbd3fa-0cc4-4083-9c22-dbffb37f0b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfbd3fa-0cc4-4083-9c22-dbffb37f0b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326777921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c483a149-b8a3-46e5-906d-b36bfdf8b3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:16Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ea8938-ab92-4024-9f50-9cb8eb95401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ea8938-ab92-4024-9f50-9cb8eb95401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6a8dfb-83c7-49da-a812-f72dc8798aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6a8dfb-83c7-49da-a812-f72dc8798aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c483a149-b8a3-46e5-906d-b36bfdf8b3a0', 'volume_name': 'volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e562d480-7061-4d2d-badb-ec531d063ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e562d480-7061-4d2d-badb-ec531d063ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6c237c-4c6c-4326-8824-9c7d7fbcac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:15 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume c483a149-b8a3-46e5-906d-b36bfdf8b3a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0', 'volume_size': 1} Sep 08 14:03:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:16 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" returned: 0 in 5.718s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:03:16 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Converted 1024.00 MB image at 179.05 MB/s Sep 08 14:03:16 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 is being set with open permissions: ugo+rw Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:16 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 Sep 08 14:03:16 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:16 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" returned: 0 in 0.241s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" released by "_copy_volume_from_snapshot" :: held 6.847s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-0852e2ac-4a97-4db2-9001-b904dfd5635a-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" released by "_create_volume_from_snapshot" :: held 6.932s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.961s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.153s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188024910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e668aea3-fdd7-4817-b6fa-ed23084f96bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:11Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Creating volume e668aea3-fdd7-4817-b6fa-ed23084f96bb {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:16 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:16 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb 1073741824 Sep 08 14:03:16 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ff4ff3-76e2-488b-b577-a84bde714aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27', 'volume_size': 1, 'snapshot_id': '0852e2ac-4a97-4db2-9001-b904dfd5635a'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d2b9bb-7f3f-4e2d-8dea-107bec048f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:16 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Volume volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 (13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27): created successfully Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d2b9bb-7f3f-4e2d-8dea-107bec048f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Flow 'volume_create_manager' (3aa675f9-9bc2-4df9-8bf4-72938d861945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:16 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-231ede7b-4199-4997-9086-00677a2b015e tempest-VolumeDependencyTests-1301272125 None] Created volume successfully. Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-0852e2ac-4a97-4db2-9001-b904dfd5635a-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-0852e2ac-4a97-4db2-9001-b904dfd5635a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-quobyte-383f458f-7392-4437-8095-e5588ed4ca8b" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-383f458f-7392-4437-8095-e5588ed4ca8b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-quobyte-0852e2ac-4a97-4db2-9001-b904dfd5635a" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:17 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb 1073741824" returned: 0 in 0.521s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-0852e2ac-4a97-4db2-9001-b904dfd5635a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Deleting offline snapshot 0852e2ac-4a97-4db2-9001-b904dfd5635a of volume 383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] snapshot_file for this snap is: volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b421e8f-4aca-441a-b5e6-02582d41afbb]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:17 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb Sep 08 14:03:17 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:17 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a Sep 08 14:03:17 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:17 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb" returned: 0 in 0.282s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.846s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-27762533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272d688b-0363-41fb-abf1-72ee549b48cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:12Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Creating volume 272d688b-0363-41fb-abf1-72ee549b48cd {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:17 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f21e6f-d3b2-4477-bdc4-73d64d8af623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28e11e1-d01a-45b4-94db-4e6385f0eadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:17 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd 1073741824 Sep 08 14:03:17 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:17 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb (e668aea3-fdd7-4817-b6fa-ed23084f96bb): created successfully Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28e11e1-d01a-45b4-94db-4e6385f0eadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (ac327a5c-e817-4fbf-b3db-a44a2049a190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:17 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a" returned: 0 in 0.455s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-383f458f-7392-4437-8095-e5588ed4ca8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:03:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-58656869-f389-4a0b-a174-93babd1c3a0d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created volume successfully. Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6e2489-d9a3-494a-8ddf-3709f3579841]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:17 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b Sep 08 14:03:17 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:18 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd 1073741824" returned: 0 in 0.546s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:18 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd Sep 08 14:03:18 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:18 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b" returned: 0 in 0.610s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:18 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a Sep 08 14:03:18 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:18 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd" returned: 0 in 0.280s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.764s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864826124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3c90d6-e958-410f-8ff0-80bea09e8124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:13Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Creating volume 9a3c90d6-e958-410f-8ff0-80bea09e8124 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:18 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e0e721-8ed5-4188-90cb-d34b3c8354d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272d688b-0363-41fb-abf1-72ee549b48cd', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a28548-c40e-42ea-bb11-13cf0d01b3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:18 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 1073741824 Sep 08 14:03:18 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:18 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume volume-272d688b-0363-41fb-abf1-72ee549b48cd (272d688b-0363-41fb-abf1-72ee549b48cd): created successfully Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a28548-c40e-42ea-bb11-13cf0d01b3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (6be9bea9-d968-4dc8-aebc-0789078cf813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ec0e428a-cb4f-458f-94ca-1eb21d082b9e tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created volume successfully. Sep 08 14:03:18 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a" returned: 0 in 0.422s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:18 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a Sep 08 14:03:18 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:18 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 1073741824" returned: 0 in 0.536s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:18 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 Sep 08 14:03:18 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:18 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b.0852e2ac-4a97-4db2-9001-b904dfd5635a" returned: 0 in 0.293s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-0852e2ac-4a97-4db2-9001-b904dfd5635a" released by "_delete_snapshot" :: held 1.915s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-383f458f-7392-4437-8095-e5588ed4ca8b" released by "delete_snapshot" :: held 1.941s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Created reservations ['c807a6cf-8b15-46b7-ae4e-52bcf76cbb45', '138919d7-1315-4747-b85f-b02ad27499bc', '0add0a55-cfa0-4f31-a1ce-45a959502595', 'f59ebba2-d174-4b89-92ec-79407087439a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Delete snapshot completed successfully. Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1ecca9bd-57e8-4060-80ce-31c839389b06 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-0852e2ac-4a97-4db2-9001-b904dfd5635a-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:19 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124" returned: 0 in 0.299s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.460s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-526748108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fe8242-63ae-4955-83cd-ab7680c1ccb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:14Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Creating volume 87fe8242-63ae-4955-83cd-ab7680c1ccb9 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:19 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-383f458f-7392-4437-8095-e5588ed4ca8b-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64570b0-0634-4609-ad6d-a0fff14fa8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3c90d6-e958-410f-8ff0-80bea09e8124', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feeab256-916e-4f44-bc14-d5ce3ecfb0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:19 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 1073741824 Sep 08 14:03:19 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-383f458f-7392-4437-8095-e5588ed4ca8b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 (9a3c90d6-e958-410f-8ff0-80bea09e8124): created successfully Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feeab256-916e-4f44-bc14-d5ce3ecfb0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (70037219-c79f-4db8-805f-a82b7c469902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-379ac802-d134-45e2-aa8f-37ed9cd549d1 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created volume successfully. Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-quobyte-383f458f-7392-4437-8095-e5588ed4ca8b" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-383f458f-7392-4437-8095-e5588ed4ca8b" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97bc2a1-d9af-46a0-9851-0b804e363825]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:19 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b Sep 08 14:03:19 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:19 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 1073741824" returned: 0 in 0.520s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:19 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 Sep 08 14:03:19 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:19 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b" returned: 0 in 0.435s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:19 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b Sep 08 14:03:19 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:20 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9" returned: 0 in 0.266s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.095s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326777921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c483a149-b8a3-46e5-906d-b36bfdf8b3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb517c1951a4947a88c500b7c8917ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:16Z,use_quota=True,user_id='8e325a18f3d94d53b3670c3e5385f97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Creating volume c483a149-b8a3-46e5-906d-b36bfdf8b3a0 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:20 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842e8096-fe78-4b28-916a-18f7f59ef6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:20 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 1073741824 Sep 08 14:03:20 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d78cc9c-168d-4d01-93eb-5a8f474ae039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 (87fe8242-63ae-4955-83cd-ab7680c1ccb9): created successfully Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d78cc9c-168d-4d01-93eb-5a8f474ae039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (6d7f1ea4-e6d2-4865-96df-e572342fb08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:20 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-383f458f-7392-4437-8095-e5588ed4ca8b" returned: 0 in 0.288s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-44d9c46b-577e-46e9-994b-2223fe6f1d11 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created volume successfully. Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-383f458f-7392-4437-8095-e5588ed4ca8b" released by "delete_volume" :: held 0.803s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Created reservations ['290e6503-ae96-4269-9860-9c62dbeb91b8', '4f42fc29-cc46-4fee-9418-a61f0febfdad', '80b9065f-eba9-4f56-acf1-959ae3053515', 'f759393a-f41d-4591-a799-5855fa1e6015'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:20 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:20 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "cinder-quobyte-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfc3a2b-9f33-46dc-ad17-e7abbc13625a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:20 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 1073741824" returned: 0 in 0.568s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:20 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.360s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Deleted volume successfully. Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1d80fac0-2a01-4b77-8b84-9a38027d8359 tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-383f458f-7392-4437-8095-e5588ed4ca8b-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:20 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 Sep 08 14:03:20 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:20 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 Sep 08 14:03:20 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:20 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0" returned: 0 in 0.267s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6c237c-4c6c-4326-8824-9c7d7fbcac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381398ac-31ce-4444-b796-17291d844d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:21 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Volume volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 (c483a149-b8a3-46e5-906d-b36bfdf8b3a0): created successfully Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381398ac-31ce-4444-b796-17291d844d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Flow 'volume_create_manager' (4b6021cb-64b2-446e-af3f-79753103020a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:21 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fdbd5f43-7648-4fbf-8371-07cf35a0bf3f tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created volume successfully. Sep 08 14:03:21 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" returned: 0 in 0.468s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:21 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27 Sep 08 14:03:21 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-c483a149-b8a3-46e5-906d-b36bfdf8b3a0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-c483a149-b8a3-46e5-906d-b36bfdf8b3a0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-quobyte-c483a149-b8a3-46e5-906d-b36bfdf8b3a0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-c483a149-b8a3-46e5-906d-b36bfdf8b3a0" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b484021-71b9-49ba-952c-10dfb4aa85d9]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:21 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" returned: 0 in 0.293s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-quobyte-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27" released by "delete_volume" :: held 0.809s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:21 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 Sep 08 14:03:21 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Created reservations ['cf3b8ac4-ec6f-460b-a980-772236715427', '58d92aa7-012c-405f-8892-258f12061c6b', '4014cc74-87e4-4acb-8a14-ba4935bdd685', '0bac7f38-01f6-4240-ac44-028e3cb89052'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:21 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:21 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:21 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (d4958618-5921-4baa-b6c8-dcf97eace0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae9f8f5-4657-4279-825c-db6442ac8427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0" returned: 0 in 0.535s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae9f8f5-4657-4279-825c-db6442ac8427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390908853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfbe331-8571-4b2d-a566-c8cfdfc3e101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:22Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e2978a-0a56-451c-bdf9-72216d9571b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e2978a-0a56-451c-bdf9-72216d9571b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:21 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0 Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0ab060-3447-4319-830e-07e9d1d19fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:21 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:21 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0ab060-3447-4319-830e-07e9d1d19fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cfbe331-8571-4b2d-a566-c8cfdfc3e101', 'volume_name': 'volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd981691-16cb-467e-a6c8-b929d9017f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd981691-16cb-467e-a6c8-b929d9017f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bcc93a-ae7a-404f-899b-b47f7047e058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:21 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume 5cfbe331-8571-4b2d-a566-c8cfdfc3e101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101', 'volume_size': 1} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390908853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfbe331-8571-4b2d-a566-c8cfdfc3e101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:22Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Creating volume 5cfbe331-8571-4b2d-a566-c8cfdfc3e101 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:21 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:21 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Deleted volume successfully. Sep 08 14:03:21 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 1073741824 Sep 08 14:03:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3c1e597-aa6a-4f30-85a3-fbb2658cb11e tempest-VolumeDependencyTests-1301272125 None] Lock "cinder-13c3ffb0-c32f-4c4d-aaf3-9a38bcf94b27-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:21 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:22 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c483a149-b8a3-46e5-906d-b36bfdf8b3a0" returned: 0 in 0.272s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-c483a149-b8a3-46e5-906d-b36bfdf8b3a0" released by "delete_volume" :: held 0.865s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created reservations ['35ff048d-e520-4ba9-8cee-192a96cc628a', '18267e34-3a07-4ee7-a8ea-d26f9c2ff3c5', '7ef0be95-61d1-4386-bcfb-1049c3c2e19f', '81dae0d6-a9ce-44e5-b015-c7bf87a74407'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:22 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:22 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-87fe8242-63ae-4955-83cd-ab7680c1ccb9-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-87fe8242-63ae-4955-83cd-ab7680c1ccb9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-quobyte-87fe8242-63ae-4955-83cd-ab7680c1ccb9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-87fe8242-63ae-4955-83cd-ab7680c1ccb9" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d616881-fbb9-4732-9ce4-e5ec6878005b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:22 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 1073741824" returned: 0 in 0.632s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:22 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.369s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Deleted volume successfully. Sep 08 14:03:22 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 Sep 08 14:03:22 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 Sep 08 14:03:22 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:22 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f6ba5246-1670-4455-8072-620216dc6686 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-c483a149-b8a3-46e5-906d-b36bfdf8b3a0-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:22 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101" returned: 0 in 0.299s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bcc93a-ae7a-404f-899b-b47f7047e058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4923a1a-0de6-4047-8fc3-5c651ad929a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:22 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 (5cfbe331-8571-4b2d-a566-c8cfdfc3e101): created successfully Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4923a1a-0de6-4047-8fc3-5c651ad929a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (d4958618-5921-4baa-b6c8-dcf97eace0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-aa7b51e4-fe36-4403-8386-aface56ce128 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created volume successfully. Sep 08 14:03:23 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9" returned: 0 in 0.483s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:23 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9 Sep 08 14:03:23 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:23 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-87fe8242-63ae-4955-83cd-ab7680c1ccb9" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-87fe8242-63ae-4955-83cd-ab7680c1ccb9" released by "delete_volume" :: held 0.807s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created reservations ['97f4de69-68a9-4c6d-940d-818b79608896', 'c4ed4ab9-e181-4db0-865a-fa35f23dbadb', '00d7afe2-f909-4d81-b6e5-27dc04a41d46', '8aafe370-e558-44f1-b29d-257fbbe12534'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:23 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:23 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-9a3c90d6-e958-410f-8ff0-80bea09e8124-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-9a3c90d6-e958-410f-8ff0-80bea09e8124-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-quobyte-9a3c90d6-e958-410f-8ff0-80bea09e8124" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-9a3c90d6-e958-410f-8ff0-80bea09e8124" acquired by "delete_volume" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f77263-4795-4eb6-b723-9e976f579c24]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:23 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.285s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Deleted volume successfully. Sep 08 14:03:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9015075a-7624-463a-a41b-9d5269daec8c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-87fe8242-63ae-4955-83cd-ab7680c1ccb9-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:23 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 Sep 08 14:03:23 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:24 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124" returned: 0 in 0.402s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:24 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124 Sep 08 14:03:24 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:24 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9a3c90d6-e958-410f-8ff0-80bea09e8124" returned: 0 in 0.317s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-9a3c90d6-e958-410f-8ff0-80bea09e8124" released by "delete_volume" :: held 0.766s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (ab20b8a9-f9b4-4472-a659-2b06b9ad7a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45d9cc6-0160-4510-97b3-dc513add7de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45d9cc6-0160-4510-97b3-dc513add7de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691747357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9de4ad4-031a-4b8e-aa51-2402cacc7d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:24Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3feb2c-96cb-49a4-b78f-836f53295b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3feb2c-96cb-49a4-b78f-836f53295b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad30c973-ffbf-48e2-91f7-80064dbf4458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad30c973-ffbf-48e2-91f7-80064dbf4458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9de4ad4-031a-4b8e-aa51-2402cacc7d7f', 'volume_name': 'volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b84345-54ef-4fa7-9cd5-f50f5fef51f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b84345-54ef-4fa7-9cd5-f50f5fef51f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd22a42-09a4-427c-8f60-efbf5ce51818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume c9de4ad4-031a-4b8e-aa51-2402cacc7d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f', 'volume_size': 1} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691747357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9de4ad4-031a-4b8e-aa51-2402cacc7d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:24Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Creating volume c9de4ad4-031a-4b8e-aa51-2402cacc7d7f {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:24 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:24 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f 1073741824 Sep 08 14:03:24 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created reservations ['c0a22b0d-fc00-493b-bb57-53698906005b', '7427dd0b-e863-49f9-a2bd-99ddc1933d52', 'b5998618-0f20-4167-8240-424e9cbf9315', '5fa80aa7-beb2-4070-a141-529e99fbf607'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:24 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:24 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-272d688b-0363-41fb-abf1-72ee549b48cd-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-272d688b-0363-41fb-abf1-72ee549b48cd-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (ac272841-8b69-4920-85ca-c08fd6b8f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6dfba5-9d68-4f07-a3b2-e5c4e1b82e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6dfba5-9d68-4f07-a3b2-e5c4e1b82e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-701500511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075bf63f-7bca-4499-8f3b-496d1b31ee10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:25Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2255ab-a343-49f7-a8e0-4ee4935d0538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2255ab-a343-49f7-a8e0-4ee4935d0538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1563257a-40e3-4a8d-9f7e-ccb7207e6271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1563257a-40e3-4a8d-9f7e-ccb7207e6271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075bf63f-7bca-4499-8f3b-496d1b31ee10', 'volume_name': 'volume-075bf63f-7bca-4499-8f3b-496d1b31ee10', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbe26e1-58f6-4b87-91e8-119eb09dfc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbe26e1-58f6-4b87-91e8-119eb09dfc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedd5328-862b-4601-b514-23808712c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume 075bf63f-7bca-4499-8f3b-496d1b31ee10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075bf63f-7bca-4499-8f3b-496d1b31ee10', 'volume_size': 1} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-quobyte-272d688b-0363-41fb-abf1-72ee549b48cd" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.438s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Deleted volume successfully. Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-272d688b-0363-41fb-abf1-72ee549b48cd" acquired by "delete_volume" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-68681eec-ef53-4cf3-b756-5b434a8a43ba tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-9a3c90d6-e958-410f-8ff0-80bea09e8124-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[64799304-3472-41ed-8672-2715bb6f1b8a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:25 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f 1073741824" returned: 0 in 0.763s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:25 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f Sep 08 14:03:25 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:25 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd Sep 08 14:03:25 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (c161f482-2813-4307-9fd9-b448453b1468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e5f219-2fa3-4885-b2f9-1710dc922bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e5f219-2fa3-4885-b2f9-1710dc922bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450254416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c428081-be3d-454a-9d9e-b69ef650e371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:25Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da9406d-2a1d-4e2d-9688-977fc16a5c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da9406d-2a1d-4e2d-9688-977fc16a5c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2166ead5-9ef2-4f2c-af79-b6a5ea7b8023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2166ead5-9ef2-4f2c-af79-b6a5ea7b8023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c428081-be3d-454a-9d9e-b69ef650e371', 'volume_name': 'volume-6c428081-be3d-454a-9d9e-b69ef650e371', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57be962-07f3-469f-a611-e6bd7c19bbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57be962-07f3-469f-a611-e6bd7c19bbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5e1ceb-ac69-4415-9358-ace747f31f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume 6c428081-be3d-454a-9d9e-b69ef650e371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c428081-be3d-454a-9d9e-b69ef650e371', 'volume_size': 1} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:25 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f" returned: 0 in 0.406s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-701500511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075bf63f-7bca-4499-8f3b-496d1b31ee10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:25Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Creating volume 075bf63f-7bca-4499-8f3b-496d1b31ee10 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:25 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:25 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd22a42-09a4-427c-8f60-efbf5ce51818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b3193f-4ef8-47a4-9beb-05eb9520163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd" returned: 0 in 0.578s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:25 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 1073741824 Sep 08 14:03:25 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:25 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f (c9de4ad4-031a-4b8e-aa51-2402cacc7d7f): created successfully Sep 08 14:03:25 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd Sep 08 14:03:25 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b3193f-4ef8-47a4-9beb-05eb9520163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (ab20b8a9-f9b4-4472-a659-2b06b9ad7a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f66e525c-7dec-4b1e-b19e-568f31225f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created volume successfully. Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (1447f507-b7e3-4d87-9030-5c30671c7d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc07857a-08bf-4be6-85c9-75808a7504dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc07857a-08bf-4be6-85c9-75808a7504dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955163284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b2ece2-d9c5-43d8-8e08-74395d6dc06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:26Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b37940d-1daa-43bb-bcff-553763d6889d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b37940d-1daa-43bb-bcff-553763d6889d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a9f5ad-584d-49cf-ab81-44238bacaa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a9f5ad-584d-49cf-ab81-44238bacaa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b2ece2-d9c5-43d8-8e08-74395d6dc06c', 'volume_name': 'volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd587dc-ab7c-43b7-86c5-5943dbaf225f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd587dc-ab7c-43b7-86c5-5943dbaf225f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c8a61f-24e0-4218-873a-c1b4580cf593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume 83b2ece2-d9c5-43d8-8e08-74395d6dc06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c', 'volume_size': 1} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:26 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-272d688b-0363-41fb-abf1-72ee549b48cd" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-272d688b-0363-41fb-abf1-72ee549b48cd" released by "delete_volume" :: held 1.040s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created reservations ['0ed41ac0-9b6a-48a5-a2b5-5a84fff3ab6d', '4e0b1ce7-8fcc-4930-9931-05d75aed6489', 'bf10b640-0ad7-4d5b-a928-49a5572288f2', '1419dc80-bc85-4027-9182-dd4e5eb37849'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:26 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Flow 'volume_create_manager' (731db65e-2daa-4b1d-9c00-4b0d4a27f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7e987b-1431-4555-be95-dbaeb31c7e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 1073741824" returned: 0 in 0.616s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7e987b-1431-4555-be95-dbaeb31c7e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942624002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba6680e-a30b-4a43-80be-80e99ff2ee8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6c55ad64e94825be5789f9731524bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:26Z,use_quota=True,user_id='a27535db7f144f61a07ab75c0417c07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b491061-0911-4e23-b32c-6234a1633315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b491061-0911-4e23-b32c-6234a1633315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fda7b1b-5382-4820-ac86-fa49752fd387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fda7b1b-5382-4820-ac86-fa49752fd387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba6680e-a30b-4a43-80be-80e99ff2ee8a', 'volume_name': 'volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcf1757-2035-40e1-b82d-e5e46fa972b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcf1757-2035-40e1-b82d-e5e46fa972b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ab65e7-6d53-4121-9d17-d9454b27cb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Volume 5ba6680e-a30b-4a43-80be-80e99ff2ee8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a', 'volume_size': 1} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:26 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:26 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:26 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 Sep 08 14:03:26 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (61f7d56a-a6bf-4d4c-89a5-169d39088011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec3ee0d-3bc5-4dc0-9998-0fdb298a9abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec3ee0d-3bc5-4dc0-9998-0fdb298a9abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355264980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82343660-da2c-4764-aeb2-95334d5554ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:27Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfcf4d8-0d95-4fa4-8a31-29b3a94fec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfcf4d8-0d95-4fa4-8a31-29b3a94fec48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5242c96-96b7-44c5-96d2-d005673073c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5242c96-96b7-44c5-96d2-d005673073c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82343660-da2c-4764-aeb2-95334d5554ec', 'volume_name': 'volume-82343660-da2c-4764-aeb2-95334d5554ec', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce2e8c1-a45c-4223-a873-d5eaf88bc249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce2e8c1-a45c-4223-a873-d5eaf88bc249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90109e16-260c-4578-8046-397846ab7d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume 82343660-da2c-4764-aeb2-95334d5554ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82343660-da2c-4764-aeb2-95334d5554ec', 'volume_size': 1} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:26 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.256s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Deleted volume successfully. Sep 08 14:03:26 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10" returned: 0 in 0.244s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450254416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c428081-be3d-454a-9d9e-b69ef650e371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:25Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Creating volume 6c428081-be3d-454a-9d9e-b69ef650e371 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:26 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedd5328-862b-4601-b514-23808712c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075bf63f-7bca-4499-8f3b-496d1b31ee10', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 1073741824 Sep 08 14:03:26 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc541d5-035a-4bd3-a985-201191a925f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8f7a7197-0dd1-419a-9893-2b3c5bc4a95d tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-272d688b-0363-41fb-abf1-72ee549b48cd-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 (075bf63f-7bca-4499-8f3b-496d1b31ee10): created successfully Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc541d5-035a-4bd3-a985-201191a925f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (ac272841-8b69-4920-85ca-c08fd6b8f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-de4f5848-6275-41dd-b232-a6e2b12a84fe tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created volume successfully. Sep 08 14:03:27 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 1073741824" returned: 0 in 0.417s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:27 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 Sep 08 14:03:27 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-e668aea3-fdd7-4817-b6fa-ed23084f96bb-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-e668aea3-fdd7-4817-b6fa-ed23084f96bb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-quobyte-e668aea3-fdd7-4817-b6fa-ed23084f96bb" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-e668aea3-fdd7-4817-b6fa-ed23084f96bb" acquired by "delete_volume" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b950c19-bcf6-47e5-889e-0127674dc360]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:27 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb Sep 08 14:03:27 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:27 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371" returned: 0 in 0.252s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955163284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b2ece2-d9c5-43d8-8e08-74395d6dc06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:26Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Creating volume 83b2ece2-d9c5-43d8-8e08-74395d6dc06c {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:27 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:27 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c 1073741824 Sep 08 14:03:27 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5e1ceb-ac69-4415-9358-ace747f31f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c428081-be3d-454a-9d9e-b69ef650e371', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab926cbc-dfb4-4675-85ee-64788e14a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:27 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume volume-6c428081-be3d-454a-9d9e-b69ef650e371 (6c428081-be3d-454a-9d9e-b69ef650e371): created successfully Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab926cbc-dfb4-4675-85ee-64788e14a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (c161f482-2813-4307-9fd9-b448453b1468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-131bdc1e-90c2-45c9-b809-536bb4b31fbb tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created volume successfully. Sep 08 14:03:27 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb" returned: 0 in 0.375s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:27 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb Sep 08 14:03:27 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:27 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c 1073741824" returned: 0 in 0.431s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:28 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c Sep 08 14:03:28 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:28 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e668aea3-fdd7-4817-b6fa-ed23084f96bb" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-e668aea3-fdd7-4817-b6fa-ed23084f96bb" released by "delete_volume" :: held 0.688s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created reservations ['37562fe7-95df-4bff-83a7-81cf33c5d423', 'b08a5f8f-97b1-428b-a3d7-52169875803c', 'af2961b9-28f0-413b-90db-07dad6d42edc', 'da7cc92b-fc21-47d6-857f-ca21cd763c5d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:28 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:28 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:28 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c" returned: 0 in 0.267s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942624002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba6680e-a30b-4a43-80be-80e99ff2ee8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6c55ad64e94825be5789f9731524bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:26Z,use_quota=True,user_id='a27535db7f144f61a07ab75c0417c07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Creating volume 5ba6680e-a30b-4a43-80be-80e99ff2ee8a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:28 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c8a61f-24e0-4218-873a-c1b4580cf593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:28 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a 1073741824 Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f176e6-b2f8-4565-a937-6be7f4a466ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:28 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:28 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c (83b2ece2-d9c5-43d8-8e08-74395d6dc06c): created successfully Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f176e6-b2f8-4565-a937-6be7f4a466ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (1447f507-b7e3-4d87-9030-5c30671c7d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5b39b7d0-7547-427b-85a7-b2e9e475d5e5 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created volume successfully. Sep 08 14:03:28 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.250s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Deleted volume successfully. Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e5c0e475-3745-46d5-a0dd-f329072af47c tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-e668aea3-fdd7-4817-b6fa-ed23084f96bb-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-7a484e73-6dc0-42dd-b14b-b66c69968442-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-7a484e73-6dc0-42dd-b14b-b66c69968442-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-quobyte-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-quobyte-7a484e73-6dc0-42dd-b14b-b66c69968442" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-7a484e73-6dc0-42dd-b14b-b66c69968442" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Deleting offline snapshot 7a484e73-6dc0-42dd-b14b-b66c69968442 of volume bae4e06f-5fad-408c-a86f-6c1f3f88d39c {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] snapshot_file for this snap is: volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfff6709-8ea2-4506-93b6-6c848532f2a9]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:28 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 Sep 08 14:03:28 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:28 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a 1073741824" returned: 0 in 0.482s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:28 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a Sep 08 14:03:28 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:28 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442" returned: 0 in 0.359s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf59fa9-ebda-4c36-9cc8-28a61f8d5724]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:29 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a" returned: 0 in 0.258s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:29 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c Sep 08 14:03:29 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.400s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355264980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82343660-da2c-4764-aeb2-95334d5554ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5e297472754fe0998b5cc10e20678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:27Z,use_quota=True,user_id='41cfdf0b213940f09879172f16918569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Creating volume 82343660-da2c-4764-aeb2-95334d5554ec {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:29 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ab65e7-6d53-4121-9d17-d9454b27cb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:29 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec 1073741824 Sep 08 14:03:29 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5ce75e-4d60-4fa4-bf26-a6d6e6809780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:29 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Volume volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a (5ba6680e-a30b-4a43-80be-80e99ff2ee8a): created successfully Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5ce75e-4d60-4fa4-bf26-a6d6e6809780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Flow 'volume_create_manager' (731db65e-2daa-4b1d-9c00-4b0d4a27f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:29 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-167741ca-a578-4a12-8e2e-2d64b76d0811 tempest-ProjectReaderTests-1938522700 None] Created volume successfully. Sep 08 14:03:29 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:29 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 Sep 08 14:03:29 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:29 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec 1073741824" returned: 0 in 0.451s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Acquiring lock "cinder-5ba6680e-a30b-4a43-80be-80e99ff2ee8a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Lock "cinder-5ba6680e-a30b-4a43-80be-80e99ff2ee8a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:29 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec Sep 08 14:03:29 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Acquiring lock "cinder-quobyte-5ba6680e-a30b-4a43-80be-80e99ff2ee8a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Lock "cinder-quobyte-5ba6680e-a30b-4a43-80be-80e99ff2ee8a" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5059ca-774b-4a82-ab00-be6b7fa9d1d6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:29 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442" returned: 0 in 0.377s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:29 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442 Sep 08 14:03:29 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:29 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a Sep 08 14:03:29 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:29 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec" returned: 0 in 0.271s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90109e16-260c-4578-8046-397846ab7d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82343660-da2c-4764-aeb2-95334d5554ec', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c20d84f-e7f5-4b2d-9d73-c713672a80ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:29 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Volume volume-82343660-da2c-4764-aeb2-95334d5554ec (82343660-da2c-4764-aeb2-95334d5554ec): created successfully Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c20d84f-e7f5-4b2d-9d73-c713672a80ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Flow 'volume_create_manager' (61f7d56a-a6bf-4d4c-89a5-169d39088011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:29 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5bee709d-5d0d-442c-a595-90c32f3d89ed tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created volume successfully. Sep 08 14:03:29 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c.7a484e73-6dc0-42dd-b14b-b66c69968442" returned: 0 in 0.256s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-7a484e73-6dc0-42dd-b14b-b66c69968442" released by "_delete_snapshot" :: held 1.495s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" released by "delete_snapshot" :: held 1.519s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created reservations ['70c9d25a-a260-45f0-a5cd-14d2c77c7d87', '052d7785-9fbb-4e00-a903-b4989cbafe08', '140e09b0-29d3-4313-ab99-d83fca00801c', '640f3bfb-4c80-496e-a701-19a9f65c4d4b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:30 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a" returned: 0 in 0.387s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:30 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a Sep 08 14:03:30 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Delete snapshot completed successfully. Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-668e8f5d-b85c-44f2-baf5-5c215ee8d437 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-7a484e73-6dc0-42dd-b14b-b66c69968442-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:30 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5ba6680e-a30b-4a43-80be-80e99ff2ee8a" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Lock "cinder-quobyte-5ba6680e-a30b-4a43-80be-80e99ff2ee8a" released by "delete_volume" :: held 0.687s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Created reservations ['5c4152e8-3783-499a-9d3c-edb12328dfc1', '4cd702dc-85f6-4286-99da-a27c1f3cb8de', '95cc5c95-512f-4423-9a65-0e28143af31b', '85ed9e64-1a1b-40e2-8a23-57192a594473'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:30 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:30 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-bae4e06f-5fad-408c-a86f-6c1f3f88d39c-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-bae4e06f-5fad-408c-a86f-6c1f3f88d39c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:30 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.304s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "cinder-quobyte-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Deleted volume successfully. Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-84ae9ed8-46f4-4fed-9d0a-07288dbe7684 tempest-ProjectReaderTests-1938522700 None] Lock "cinder-5ba6680e-a30b-4a43-80be-80e99ff2ee8a-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab67f37-adcb-4e9b-9f53-ff75d930e930]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:31 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c Sep 08 14:03:31 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-82343660-da2c-4764-aeb2-95334d5554ec-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-82343660-da2c-4764-aeb2-95334d5554ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-quobyte-82343660-da2c-4764-aeb2-95334d5554ec" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-82343660-da2c-4764-aeb2-95334d5554ec" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[006bab09-62fc-42b4-a501-49ed04e7b9c1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:31 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" returned: 0 in 0.434s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:31 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec Sep 08 14:03:31 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:31 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c Sep 08 14:03:31 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Flow 'volume_create_manager' (0a4d0864-b88c-42de-8ccd-a0f59316f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798d0dfa-45c7-4b72-b8d2-d60058d3c70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798d0dfa-45c7-4b72-b8d2-d60058d3c70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-319020394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cc8f57-eddc-447c-95d2-007b11681158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6c55ad64e94825be5789f9731524bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:31Z,use_quota=True,user_id='a27535db7f144f61a07ab75c0417c07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d50445-1673-4e29-98a0-fe5b36b3a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d50445-1673-4e29-98a0-fe5b36b3a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dd8c1c-c110-445b-bfc1-1ad51b6f60dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dd8c1c-c110-445b-bfc1-1ad51b6f60dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47cc8f57-eddc-447c-95d2-007b11681158', 'volume_name': 'volume-47cc8f57-eddc-447c-95d2-007b11681158', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07aa774-172b-45ea-ac4e-0bd475d60b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07aa774-172b-45ea-ac4e-0bd475d60b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0374bf-3103-45a6-b89c-cf13c2934f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:31 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Volume 47cc8f57-eddc-447c-95d2-007b11681158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47cc8f57-eddc-447c-95d2-007b11681158', 'volume_size': 1} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-319020394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cc8f57-eddc-447c-95d2-007b11681158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6c55ad64e94825be5789f9731524bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:31Z,use_quota=True,user_id='a27535db7f144f61a07ab75c0417c07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Creating volume 47cc8f57-eddc-447c-95d2-007b11681158 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:31 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:31 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:31 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 1073741824 Sep 08 14:03:31 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-quobyte-bae4e06f-5fad-408c-a86f-6c1f3f88d39c" released by "delete_volume" :: held 0.770s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:31 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec" returned: 0 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:31 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec Sep 08 14:03:31 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Created reservations ['0e5643c0-f5a4-4988-89af-12b5a97cf109', '6e6e3324-6228-4ecf-9eab-201537d8f707', 'b26dd4cb-7440-4db5-8914-bc5e777f80aa', 'd3583c0a-fedf-4dae-9b08-48263ecccaee'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:31 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:31 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:31 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-82343660-da2c-4764-aeb2-95334d5554ec" returned: 0 in 0.308s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-82343660-da2c-4764-aeb2-95334d5554ec" released by "delete_volume" :: held 0.776s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:31 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created reservations ['6622c569-2ef1-4c8f-b7d7-a98d93cf9a63', '299361ac-52c5-4b03-948d-5a7faa6a973c', 'b86b389f-5128-4fa1-8a4e-6f0c6ab9ba92', '4194f57b-a038-458a-b11d-a28644f7c9e1'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:31 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:32 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Deleted volume successfully. Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b8612b89-84b6-4fa0-b242-d98e0788b7b7 tempest-CreateVolumesFromSnapshotTest-1993041431 None] Lock "cinder-bae4e06f-5fad-408c-a86f-6c1f3f88d39c-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:32 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 1073741824" returned: 0 in 0.539s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:32 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:32 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:32 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 Sep 08 14:03:32 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-83b2ece2-d9c5-43d8-8e08-74395d6dc06c-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-83b2ece2-d9c5-43d8-8e08-74395d6dc06c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-quobyte-83b2ece2-d9c5-43d8-8e08-74395d6dc06c" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-83b2ece2-d9c5-43d8-8e08-74395d6dc06c" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d21cc47-16bf-4737-a132-603621146113]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:32 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.355s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:32 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Deleted volume successfully. Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a277e2a3-3a33-4ba8-9792-a27efd394f18 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-82343660-da2c-4764-aeb2-95334d5554ec-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:32 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c Sep 08 14:03:32 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:32 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158" returned: 0 in 0.384s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0374bf-3103-45a6-b89c-cf13c2934f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47cc8f57-eddc-447c-95d2-007b11681158', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c44892-481d-4e72-bd3f-4cc83a81cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:32 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Volume volume-47cc8f57-eddc-447c-95d2-007b11681158 (47cc8f57-eddc-447c-95d2-007b11681158): created successfully Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c44892-481d-4e72-bd3f-4cc83a81cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Flow 'volume_create_manager' (0a4d0864-b88c-42de-8ccd-a0f59316f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:32 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ae4f20f1-dae7-426e-abfc-d0e3d5dea53d tempest-ProjectReaderTests-1938522700 None] Created volume successfully. Sep 08 14:03:32 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c" returned: 0 in 0.401s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:32 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c Sep 08 14:03:32 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:33 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-83b2ece2-d9c5-43d8-8e08-74395d6dc06c" returned: 0 in 0.251s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-83b2ece2-d9c5-43d8-8e08-74395d6dc06c" released by "delete_volume" :: held 0.704s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created reservations ['46a2dc00-ed2e-4185-8037-2f88376da5dc', 'ea289291-163e-4508-8fd0-d8f5d1de88df', '1c0c55da-0f65-4b23-9210-6d1f5976232e', 'c2654ca2-98a7-4162-88bb-62fb24ac0ed9'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:33 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:33 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-6c428081-be3d-454a-9d9e-b69ef650e371-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:33 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-6c428081-be3d-454a-9d9e-b69ef650e371-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.316s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:33 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Deleted volume successfully. Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b9c0373f-4a63-414d-b85a-0afbf9875b7b tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-83b2ece2-d9c5-43d8-8e08-74395d6dc06c-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-quobyte-6c428081-be3d-454a-9d9e-b69ef650e371" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Acquiring lock "cinder-47cc8f57-eddc-447c-95d2-007b11681158-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-6c428081-be3d-454a-9d9e-b69ef650e371" acquired by "delete_volume" :: waited 0.041s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Lock "cinder-47cc8f57-eddc-447c-95d2-007b11681158-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8376ff8-028f-4af2-acd8-733f5bc6a834]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Acquiring lock "cinder-quobyte-47cc8f57-eddc-447c-95d2-007b11681158" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Lock "cinder-quobyte-47cc8f57-eddc-447c-95d2-007b11681158" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d571fbf-d881-4e0c-bc20-d95972bb48cf]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:33 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 Sep 08 14:03:33 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:33 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 Sep 08 14:03:33 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:34 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371" returned: 0 in 0.404s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:34 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371 Sep 08 14:03:34 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:34 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158" returned: 0 in 0.410s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:34 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158 Sep 08 14:03:34 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:34 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6c428081-be3d-454a-9d9e-b69ef650e371" returned: 0 in 0.269s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-6c428081-be3d-454a-9d9e-b69ef650e371" released by "delete_volume" :: held 0.738s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created reservations ['bdefb54e-db55-47a4-ad12-b03598317515', '4ec36525-97fd-4304-ba5a-9f8db39338a0', 'c9245323-2004-4e2c-8478-df29845f6936', 'fa7f4f6a-ad9d-4eeb-8d08-08bf63c13602'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:34 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-47cc8f57-eddc-447c-95d2-007b11681158" returned: 0 in 0.266s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Lock "cinder-quobyte-47cc8f57-eddc-447c-95d2-007b11681158" released by "delete_volume" :: held 0.722s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Created reservations ['eea6dfc1-0a82-40c5-9430-d8164c51e894', 'b6ef14ad-d49e-4b3d-8f1b-894adeeda3c3', '804184a7-dbd0-4d45-b6b2-0cead5562130', '81741090-6f32-4895-8667-7f2e27577c31'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:34 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:34 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:34 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:34 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-075bf63f-7bca-4499-8f3b-496d1b31ee10-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-075bf63f-7bca-4499-8f3b-496d1b31ee10-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-quobyte-075bf63f-7bca-4499-8f3b-496d1b31ee10" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-075bf63f-7bca-4499-8f3b-496d1b31ee10" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c2ca0b-9b3a-4da1-a946-1cbfb9c6bd14]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:34 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.435s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Deleted volume successfully. Sep 08 14:03:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3089aa71-04ea-4f1e-9089-74fa3d706874 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-6c428081-be3d-454a-9d9e-b69ef650e371-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:35 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.402s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:35 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Deleted volume successfully. Sep 08 14:03:35 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 Sep 08 14:03:35 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e9a99cb7-f82e-44e8-b89a-fae40dbb6ee7 tempest-ProjectReaderTests-1938522700 None] Lock "cinder-47cc8f57-eddc-447c-95d2-007b11681158-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:35 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10" returned: 0 in 0.439s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:35 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10 Sep 08 14:03:35 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:35 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-075bf63f-7bca-4499-8f3b-496d1b31ee10" returned: 0 in 0.244s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-075bf63f-7bca-4499-8f3b-496d1b31ee10" released by "delete_volume" :: held 0.747s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created reservations ['7f42fd8d-4354-4926-a95f-c6ad9e2f856a', '23bbe991-5c9d-41ea-a56c-b3441c8425c4', '1b30aa44-544f-4483-9eb7-2f4509fffdd9', '8901c6e7-a4f4-4798-bfd3-f6be7e8a811a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:35 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:35 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-quobyte-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f" acquired by "delete_volume" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a0fa3-c403-4dfb-ab49-cea910b0023c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:36 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.386s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Deleted volume successfully. Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-143ab42e-6f82-47e6-a588-119b4100e780 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-075bf63f-7bca-4499-8f3b-496d1b31ee10-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:36 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f Sep 08 14:03:36 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:36 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f" returned: 0 in 0.481s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:36 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f Sep 08 14:03:36 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:36 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f" returned: 0 in 0.349s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f" released by "delete_volume" :: held 0.896s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created reservations ['b80f8f55-ac8f-4a32-a129-8e11fcd12de8', 'c1c0c987-8e71-4414-8dd3-aaab64fc970c', 'c0b01e90-3ae9-4d67-b6dc-5da56381b904', 'ccd0d83b-2b21-4e14-b637-653c4248ef32'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-5cfbe331-8571-4b2d-a566-c8cfdfc3e101-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-5cfbe331-8571-4b2d-a566-c8cfdfc3e101-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:37 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:37 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "cinder-quobyte-5cfbe331-8571-4b2d-a566-c8cfdfc3e101" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-5cfbe331-8571-4b2d-a566-c8cfdfc3e101" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b318d1-764f-4254-92ca-c24e96832780]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:37 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 Sep 08 14:03:37 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:37 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.349s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:37 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Deleted volume successfully. Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a0d79f3b-7ecf-41fb-a824-c7bca79be987 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-c9de4ad4-031a-4b8e-aa51-2402cacc7d7f-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:37 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101" returned: 0 in 0.465s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:37 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101 Sep 08 14:03:37 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:37 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5cfbe331-8571-4b2d-a566-c8cfdfc3e101" returned: 0 in 0.253s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-quobyte-5cfbe331-8571-4b2d-a566-c8cfdfc3e101" released by "delete_volume" :: held 0.768s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Created reservations ['4a9d59b5-2ae7-430d-84a9-bc741b110bc4', '755a8301-0469-48c7-ae11-e6252dcfa0bd', 'acc0530b-095c-40a1-8391-b5469557642c', 'b7da8694-bfab-479a-8731-b9fc31aaf736'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:38 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:38 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:38 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.288s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Deleted volume successfully. Sep 08 14:03:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de7b0d4c-18c3-4c71-984e-c21677e05bc7 tempest-CreateVolumesFromSourceVolumeTest-265530189 None] Lock "cinder-5cfbe331-8571-4b2d-a566-c8cfdfc3e101-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Flow 'volume_create_manager' (c9a960c0-287f-4489-a0bb-ffaafee451ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623197a7-2b64-4acd-b2fc-ac7da47a7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623197a7-2b64-4acd-b2fc-ac7da47a7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516777948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fda67a1-4949-45f5-a307-435ad1cdc907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f928ed84b2341aeb9db74e0c6d49dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:44Z,use_quota=True,user_id='39705b5e09b8486ea90ee63c1b621354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3af7fd-58a0-4d6c-907b-9c47b610bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3af7fd-58a0-4d6c-907b-9c47b610bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3072422-9505-402e-98e7-682de61aa6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3072422-9505-402e-98e7-682de61aa6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fda67a1-4949-45f5-a307-435ad1cdc907', 'volume_name': 'volume-8fda67a1-4949-45f5-a307-435ad1cdc907', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572463db-78c4-4797-8c3a-a86b8294ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572463db-78c4-4797-8c3a-a86b8294ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d461a46e-1499-4534-8246-3cdcfb32530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:44 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Volume 8fda67a1-4949-45f5-a307-435ad1cdc907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fda67a1-4949-45f5-a307-435ad1cdc907', 'volume_size': 1} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516777948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fda67a1-4949-45f5-a307-435ad1cdc907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f928ed84b2341aeb9db74e0c6d49dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:44Z,use_quota=True,user_id='39705b5e09b8486ea90ee63c1b621354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Creating volume 8fda67a1-4949-45f5-a307-435ad1cdc907 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:44 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:44 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 1073741824 Sep 08 14:03:44 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:44 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 1073741824" returned: 0 in 0.402s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:44 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 Sep 08 14:03:44 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:44 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907" returned: 0 in 0.242s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d461a46e-1499-4534-8246-3cdcfb32530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fda67a1-4949-45f5-a307-435ad1cdc907', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9a987a-5579-4d30-b3ac-cd40772565dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:44 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Volume volume-8fda67a1-4949-45f5-a307-435ad1cdc907 (8fda67a1-4949-45f5-a307-435ad1cdc907): created successfully Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9a987a-5579-4d30-b3ac-cd40772565dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Flow 'volume_create_manager' (c9a960c0-287f-4489-a0bb-ffaafee451ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9eaa7c43-bdb4-47d7-b582-a883f7a5eede tempest-ProjectReaderTests-2042952882 None] Created volume successfully. Sep 08 14:03:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "cinder-8fda67a1-4949-45f5-a307-435ad1cdc907-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-8fda67a1-4949-45f5-a307-435ad1cdc907-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "cinder-quobyte-8fda67a1-4949-45f5-a307-435ad1cdc907" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-quobyte-8fda67a1-4949-45f5-a307-435ad1cdc907" acquired by "delete_volume" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:45 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8c17e7-6d0d-4c64-8be1-0bfbc46a0e76]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:45 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 Sep 08 14:03:45 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:45 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907" returned: 0 in 0.350s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:45 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907 Sep 08 14:03:45 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:46 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8fda67a1-4949-45f5-a307-435ad1cdc907" returned: 0 in 0.248s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-quobyte-8fda67a1-4949-45f5-a307-435ad1cdc907" released by "delete_volume" :: held 0.634s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Created reservations ['1059acad-649d-4f1a-a230-a265ce42b15f', '9bcee5bc-8810-49fe-b2ef-a8cfb4516c16', '88206a34-f161-4ed7-96a0-2c30b5a9939e', 'a47e386f-ac3d-4ebb-8a0d-a0758372d8bd'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:46 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:46 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:46 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.281s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:46 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Deleted volume successfully. Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a5a2ba35-af67-4579-8179-616e0e2c87f0 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-8fda67a1-4949-45f5-a307-435ad1cdc907-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Flow 'volume_create_manager' (424cda08-fdc2-4381-9620-c74592deda4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b53f64-2914-4d5d-a254-2d5273b55067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b53f64-2914-4d5d-a254-2d5273b55067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2147319127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9dc8d5-d308-40e5-b640-34c833c52553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f928ed84b2341aeb9db74e0c6d49dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:47Z,use_quota=True,user_id='39705b5e09b8486ea90ee63c1b621354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55afd817-2423-4688-8bb3-02051dadfa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55afd817-2423-4688-8bb3-02051dadfa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711b2346-9746-4018-9baf-36baecbe5c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711b2346-9746-4018-9baf-36baecbe5c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9dc8d5-d308-40e5-b640-34c833c52553', 'volume_name': 'volume-ed9dc8d5-d308-40e5-b640-34c833c52553', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20a75b1-a819-498b-a8f5-4bc17a0e6e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20a75b1-a819-498b-a8f5-4bc17a0e6e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:46 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844721d8-b6c2-4f28-8369-cfcc90c59bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:47 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Volume ed9dc8d5-d308-40e5-b640-34c833c52553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9dc8d5-d308-40e5-b640-34c833c52553', 'volume_size': 1} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2147319127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9dc8d5-d308-40e5-b640-34c833c52553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f928ed84b2341aeb9db74e0c6d49dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:47Z,use_quota=True,user_id='39705b5e09b8486ea90ee63c1b621354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Creating volume ed9dc8d5-d308-40e5-b640-34c833c52553 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:47 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:47 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 1073741824 Sep 08 14:03:47 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:47 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 1073741824" returned: 0 in 0.419s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:47 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 Sep 08 14:03:47 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:47 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553" returned: 0 in 0.247s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844721d8-b6c2-4f28-8369-cfcc90c59bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9dc8d5-d308-40e5-b640-34c833c52553', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ad3d2f-4f8d-449b-a3cd-03e2248ba475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:47 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Volume volume-ed9dc8d5-d308-40e5-b640-34c833c52553 (ed9dc8d5-d308-40e5-b640-34c833c52553): created successfully Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ad3d2f-4f8d-449b-a3cd-03e2248ba475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Flow 'volume_create_manager' (424cda08-fdc2-4381-9620-c74592deda4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:47 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-36efde69-b829-41e7-a770-5c1304a94cf2 tempest-ProjectReaderTests-2042952882 None] Created volume successfully. Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Acquiring lock "cinder-ed9dc8d5-d308-40e5-b640-34c833c52553-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Lock "cinder-ed9dc8d5-d308-40e5-b640-34c833c52553-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Acquiring lock "cinder-quobyte-ed9dc8d5-d308-40e5-b640-34c833c52553" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Lock "cinder-quobyte-ed9dc8d5-d308-40e5-b640-34c833c52553" acquired by "delete_volume" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f162258d-20b6-41d1-8668-33396be840b6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:48 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 Sep 08 14:03:48 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:48 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553" returned: 0 in 0.345s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:48 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553 Sep 08 14:03:48 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:48 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ed9dc8d5-d308-40e5-b640-34c833c52553" returned: 0 in 0.246s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Lock "cinder-quobyte-ed9dc8d5-d308-40e5-b640-34c833c52553" released by "delete_volume" :: held 0.629s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Created reservations ['c6e0dd7c-97b9-47ff-96c4-221bec1e8de0', '5cd109e3-653d-4a82-9d45-447c296342ba', '90950a4c-5889-4389-848f-c26dae4d7783', '7fc79b48-5c23-4341-a2e9-2ba7d6dba3b6'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:49 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:49 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:49 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.231s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:49 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Deleted volume successfully. Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55968e2d-ebf5-4726-87aa-efb24338c1fd tempest-ProjectReaderTests-2042952882 None] Lock "cinder-ed9dc8d5-d308-40e5-b640-34c833c52553-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Flow 'volume_create_manager' (84d5c8a4-91b6-4d00-9829-e1ea7e24787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b1c3cd-54b8-43aa-bc17-fb12a44e3804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b1c3cd-54b8-43aa-bc17-fb12a44e3804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314671476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c1da0a-8d64-42f5-96ef-8d186a7436c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f928ed84b2341aeb9db74e0c6d49dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:50Z,use_quota=True,user_id='39705b5e09b8486ea90ee63c1b621354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb13b187-43fa-4079-8fe7-20bab9820e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb13b187-43fa-4079-8fe7-20bab9820e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ab12b1-d51e-42c7-b827-fbafa4c7eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ab12b1-d51e-42c7-b827-fbafa4c7eecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c1da0a-8d64-42f5-96ef-8d186a7436c1', 'volume_name': 'volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1a9bd7-387b-4cec-9db6-e78a87fc0123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1a9bd7-387b-4cec-9db6-e78a87fc0123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ad3174-ad4b-4188-a4bc-87ef198655b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:49 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Volume 06c1da0a-8d64-42f5-96ef-8d186a7436c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1', 'volume_size': 1} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314671476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c1da0a-8d64-42f5-96ef-8d186a7436c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f928ed84b2341aeb9db74e0c6d49dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:50Z,use_quota=True,user_id='39705b5e09b8486ea90ee63c1b621354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Creating volume 06c1da0a-8d64-42f5-96ef-8d186a7436c1 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:49 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:49 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 1073741824 Sep 08 14:03:49 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:50 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 1073741824" returned: 0 in 0.378s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:50 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 Sep 08 14:03:50 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:50 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1" returned: 0 in 0.239s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] <== create_volume: return (655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.657s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ad3174-ad4b-4188-a4bc-87ef198655b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174b1d61-ed03-41e7-adfd-1470bc2ed9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Volume volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 (06c1da0a-8d64-42f5-96ef-8d186a7436c1): created successfully Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174b1d61-ed03-41e7-adfd-1470bc2ed9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Flow 'volume_create_manager' (84d5c8a4-91b6-4d00-9829-e1ea7e24787a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:50 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4434fc90-1973-4e31-a227-5bf1d0b2a91a tempest-ProjectReaderTests-2042952882 None] Created volume successfully. Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "cinder-06c1da0a-8d64-42f5-96ef-8d186a7436c1-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-06c1da0a-8d64-42f5-96ef-8d186a7436c1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "cinder-quobyte-06c1da0a-8d64-42f5-96ef-8d186a7436c1" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-quobyte-06c1da0a-8d64-42f5-96ef-8d186a7436c1" acquired by "delete_volume" :: waited 0.013s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4e3674-c163-46c2-9ebf-406c3557fcc9]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:51 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 Sep 08 14:03:51 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:51 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1" returned: 0 in 0.342s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:51 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1 Sep 08 14:03:51 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:51 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-06c1da0a-8d64-42f5-96ef-8d186a7436c1" returned: 0 in 0.239s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-quobyte-06c1da0a-8d64-42f5-96ef-8d186a7436c1" released by "delete_volume" :: held 0.615s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Created reservations ['cf02679e-2391-4fb5-ba4b-1f2c7d87102a', 'e047bee6-6410-483a-bdd8-df1daaa4714b', '4c4d767b-13f0-45a2-a97f-358ab4e27374', 'bda68635-4915-4ec8-8a8b-c2027efa7a5e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:51 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:51 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:51 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.231s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Deleted volume successfully. Sep 08 14:03:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-51a74444-0770-422e-b086-01b81bda9731 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-06c1da0a-8d64-42f5-96ef-8d186a7436c1-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Flow 'volume_create_manager' (9547d56c-994b-41e9-bbd4-27c0a08e74d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5662a936-ccf8-4b95-9197-fa923355e593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5662a936-ccf8-4b95-9197-fa923355e593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101950614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f928ed84b2341aeb9db74e0c6d49dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:52Z,use_quota=True,user_id='39705b5e09b8486ea90ee63c1b621354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38deeee-b8db-4246-88ca-e13395b3f46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38deeee-b8db-4246-88ca-e13395b3f46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def8d266-d4e3-4868-a6ff-66659667cd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def8d266-d4e3-4868-a6ff-66659667cd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca', 'volume_name': 'volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840891e8-3048-4f9e-89b9-79192da1c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840891e8-3048-4f9e-89b9-79192da1c88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4a48cf-4178-4664-8c0c-4b5b34b9e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:52 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Volume d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca', 'volume_size': 1} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101950614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f928ed84b2341aeb9db74e0c6d49dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:03:52Z,use_quota=True,user_id='39705b5e09b8486ea90ee63c1b621354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Creating volume d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:03:52 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:52 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca 1073741824 Sep 08 14:03:52 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:52 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca 1073741824" returned: 0 in 0.383s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:52 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca Sep 08 14:03:52 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:53 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca" returned: 0 in 0.249s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4a48cf-4178-4664-8c0c-4b5b34b9e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b04c24c-b84f-422f-b970-d3cca8c3137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:03:53 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Volume volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca (d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca): created successfully Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b04c24c-b84f-422f-b970-d3cca8c3137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Flow 'volume_create_manager' (9547d56c-994b-41e9-bbd4-27c0a08e74d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:03:53 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8e647711-eda4-43c0-9665-f47fe369beed tempest-ProjectReaderTests-2042952882 None] Created volume successfully. Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "cinder-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "cinder-quobyte-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-quobyte-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8071b6-d489-47c8-819d-1eea9acca07d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:53 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca Sep 08 14:03:53 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:53 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca" returned: 0 in 0.359s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:53 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca Sep 08 14:03:53 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:54 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca" returned: 0 in 0.242s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-quobyte-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca" released by "delete_volume" :: held 0.639s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Created reservations ['8f5472c2-880e-47ff-ad72-81d0ac012eee', '3011eb40-433b-4871-85b9-6c0e91996f37', 'b3a6021f-4eb7-41b3-9dcd-587c4cad3858', '5389a006-f79d-4eb9-add5-80c84ae3b7d7'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:03:54 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:03:54 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:03:54 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.245s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:03:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Deleted volume successfully. Sep 08 14:03:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e009e88-2e42-444d-a3ee-c4a9c0fbf486 tempest-ProjectReaderTests-2042952882 None] Lock "cinder-d0dce7ef-d3e6-4b38-8c2b-bd90eedf79ca-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:03 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:04:03 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:03 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 14:04:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 14:04:04 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=153,cinder:UPDATE=238,cinder:DELETE=24,cinder:INSERT=55 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:04:04 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=174,cinder:INSERT=59,cinder:UPDATE=246,cinder:DELETE=19 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Flow 'volume_create_manager' (fdd619bf-9950-4999-b9f5-f986ea3e63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee28a42-ce81-4b32-933f-c1f7947c4e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee28a42-ce81-4b32-933f-c1f7947c4e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-687650466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d954a8d0-6199-4f89-a52e-1a9b86511b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01128708fca4a728ade82b15f05246a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:15Z,use_quota=True,user_id='7237e905dd93412796e83c884dcdeca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d4e327-fb2b-4c8d-9fe5-2457f5a0103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d4e327-fb2b-4c8d-9fe5-2457f5a0103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d16d42-5b36-4e5f-9ca9-141f052f07a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d16d42-5b36-4e5f-9ca9-141f052f07a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd954a8d0-6199-4f89-a52e-1a9b86511b0f', 'volume_name': 'volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a42f34d-0dec-4c81-9495-4363bb70d9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a42f34d-0dec-4c81-9495-4363bb70d9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c65fdc-1b84-4e3e-b476-8d97dac42401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:15 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Volume d954a8d0-6199-4f89-a52e-1a9b86511b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f', 'volume_size': 1} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-687650466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d954a8d0-6199-4f89-a52e-1a9b86511b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01128708fca4a728ade82b15f05246a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:15Z,use_quota=True,user_id='7237e905dd93412796e83c884dcdeca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Creating volume d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:15 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:15 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f 1073741824 Sep 08 14:04:15 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:15 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f 1073741824" returned: 0 in 0.398s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:15 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f Sep 08 14:04:15 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:15 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f" returned: 0 in 0.251s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c65fdc-1b84-4e3e-b476-8d97dac42401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff00e81-225d-4434-8b6d-46fea69ae7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:15 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Volume volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f (d954a8d0-6199-4f89-a52e-1a9b86511b0f): created successfully Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff00e81-225d-4434-8b6d-46fea69ae7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Flow 'volume_create_manager' (fdd619bf-9950-4999-b9f5-f986ea3e63fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-bd9a7183-9082-4749-b050-914b60c6b289 tempest-SnapshotDependencyTests-1979729819 None] Created volume successfully. Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Creating offline snapshot 7237824a-2994-4c39-8108-0bfce6ca4e7a of volume d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44d9785-00bb-482b-9931-e4e205e506c8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:16 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f Sep 08 14:04:16 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:16 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f" returned: 0 in 0.346s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:16 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a 1G Sep 08 14:04:16 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:16 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a 1G" returned: 0 in 0.377s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:16 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a Sep 08 14:04:16 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:17 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:17 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a is being set with open permissions: ugo+rw Sep 08 14:04:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:17 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a Sep 08 14:04:17 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:17 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a" returned: 0 in 0.243s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:17 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.info Sep 08 14:04:17 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:17 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.info" returned: 0 in 0.238s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:17 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.info is being set with open permissions: ugo+rw Sep 08 14:04:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:17 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.info Sep 08 14:04:17 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:17 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.info" returned: 0 in 0.232s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-69c580b5-5ee8-446b-8021-59e78e744b78 tempest-SnapshotDependencyTests-1979729819 None] Create snapshot completed successfully Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Flow 'volume_create_manager' (6aa93879-466e-44ac-a68d-3ef6b740fcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f035968b-c478-434e-88d6-a39ff85aba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f035968b-c478-434e-88d6-a39ff85aba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab354d3-7d8d-4c65-9775-26bf86b4ad5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01128708fca4a728ade82b15f05246a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7237824a-2994-4c39-8108-0bfce6ca4e7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:19Z,use_quota=True,user_id='7237e905dd93412796e83c884dcdeca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b08ca1-c20c-4136-a969-328710438aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b08ca1-c20c-4136-a969-328710438aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7247766f-3c81-47da-a45e-a7be99dabb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7247766f-3c81-47da-a45e-a7be99dabb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cab354d3-7d8d-4c65-9775-26bf86b4ad5d', 'volume_name': 'volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d', 'volume_size': 1, 'snapshot_id': '7237824a-2994-4c39-8108-0bfce6ca4e7a'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd45cd9-89bf-4cd6-a1ef-17b84682807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd45cd9-89bf-4cd6-a1ef-17b84682807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb5d81d-ac87-4762-b33a-8993073d91f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:18 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Volume cab354d3-7d8d-4c65-9775-26bf86b4ad5d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d', 'volume_size': 1, 'snapshot_id': '7237824a-2994-4c39-8108-0bfce6ca4e7a'} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-quobyte-7237824a-2994-4c39-8108-0bfce6ca4e7a-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-7237824a-2994-4c39-8108-0bfce6ca4e7a-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Creating volume cab354d3-7d8d-4c65-9775-26bf86b4ad5d from snapshot 7237824a-2994-4c39-8108-0bfce6ca4e7a {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-quobyte-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] snapshot: 7237824a-2994-4c39-8108-0bfce6ca4e7a, volume: cab354d3-7d8d-4c65-9775-26bf86b4ad5d, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6076ae89-9da5-4c70-8532-1160c2fc26db]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:19 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a Sep 08 14:04:19 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:19 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a" returned: 0 in 0.352s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d4e8d-87cd-47bb-a87c-2e3bdc232815]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:19 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f Sep 08 14:04:19 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:19 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f" returned: 0 in 0.365s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 14:04:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:19 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d Sep 08 14:04:19 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:23 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" returned: 0 in 3.983s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:23 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:04:23 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Converted 1024.00 MB image at 256.94 MB/s Sep 08 14:04:23 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d is being set with open permissions: ugo+rw Sep 08 14:04:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:23 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d Sep 08 14:04:23 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:23 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" returned: 0 in 0.261s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" released by "_copy_volume_from_snapshot" :: held 5.035s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-7237824a-2994-4c39-8108-0bfce6ca4e7a-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" released by "_create_volume_from_snapshot" :: held 5.096s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.114s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb5d81d-ac87-4762-b33a-8993073d91f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d', 'volume_size': 1, 'snapshot_id': '7237824a-2994-4c39-8108-0bfce6ca4e7a'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a111eeb0-56c4-4ea0-8f05-e9cf09857025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Volume volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d (cab354d3-7d8d-4c65-9775-26bf86b4ad5d): created successfully Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a111eeb0-56c4-4ea0-8f05-e9cf09857025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Flow 'volume_create_manager' (6aa93879-466e-44ac-a68d-3ef6b740fcc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-62a736c2-7687-49ff-ab78-a11a4f7e1e38 tempest-SnapshotDependencyTests-1979729819 None] Created volume successfully. Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-7237824a-2994-4c39-8108-0bfce6ca4e7a-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-7237824a-2994-4c39-8108-0bfce6ca4e7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-quobyte-d954a8d0-6199-4f89-a52e-1a9b86511b0f" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-d954a8d0-6199-4f89-a52e-1a9b86511b0f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-quobyte-7237824a-2994-4c39-8108-0bfce6ca4e7a" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-7237824a-2994-4c39-8108-0bfce6ca4e7a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Deleting offline snapshot 7237824a-2994-4c39-8108-0bfce6ca4e7a of volume d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] snapshot_file for this snap is: volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a315bf-91c4-4578-8347-d94b30fa9097]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:24 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a Sep 08 14:04:24 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:24 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a" returned: 0 in 0.342s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dc6e15-8db4-4db4-b661-9a2cb5959e20]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:24 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f Sep 08 14:04:24 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:25 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f" returned: 0 in 0.504s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:25 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a Sep 08 14:04:25 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:25 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a" returned: 0 in 0.319s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:25 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a Sep 08 14:04:25 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:25 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f.7237824a-2994-4c39-8108-0bfce6ca4e7a" returned: 0 in 0.263s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-7237824a-2994-4c39-8108-0bfce6ca4e7a" released by "_delete_snapshot" :: held 1.519s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-d954a8d0-6199-4f89-a52e-1a9b86511b0f" released by "delete_snapshot" :: held 1.541s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Created reservations ['0b90deaf-8356-4d79-8c6f-2426f7c5e3d6', 'd5648e71-d406-4b43-84ba-a8c5990da678', 'a90a67a7-3c11-437d-8b38-45957a113bac', 'de847050-2d5b-4193-a5b4-c0b397d1b774'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:04:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Delete snapshot completed successfully. Sep 08 14:04:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7f1db495-50bc-470e-a356-29006ffcc944 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-7237824a-2994-4c39-8108-0bfce6ca4e7a-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-d954a8d0-6199-4f89-a52e-1a9b86511b0f-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-d954a8d0-6199-4f89-a52e-1a9b86511b0f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-quobyte-d954a8d0-6199-4f89-a52e-1a9b86511b0f" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-d954a8d0-6199-4f89-a52e-1a9b86511b0f" acquired by "delete_volume" :: waited 0.013s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e5ba8-5f06-4464-bb6e-0c83ad7bbc43]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:26 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f Sep 08 14:04:26 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:26 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f" returned: 0 in 0.344s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:26 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f Sep 08 14:04:26 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:27 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d954a8d0-6199-4f89-a52e-1a9b86511b0f" returned: 0 in 0.235s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-d954a8d0-6199-4f89-a52e-1a9b86511b0f" released by "delete_volume" :: held 0.632s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Created reservations ['2f799359-fce8-40b4-b372-4ffaaf5a18d9', 'fabd0957-882c-4ad8-8625-470f97825887', '1e613335-069e-423f-b024-825ed5a4e419', '3c7bac01-6ccf-4bf3-bc58-72ba94a946cf'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:27 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:04:27 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:27 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.235s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:04:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Deleted volume successfully. Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e392d357-e96d-425e-9796-5941c63c0847 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-d954a8d0-6199-4f89-a52e-1a9b86511b0f-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-cab354d3-7d8d-4c65-9775-26bf86b4ad5d-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-cab354d3-7d8d-4c65-9775-26bf86b4ad5d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "cinder-quobyte-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" acquired by "delete_volume" :: waited 0.013s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f471fe38-57d6-4d09-8d3f-1323adef2efa]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:27 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d Sep 08 14:04:27 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:28 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" returned: 0 in 0.343s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:28 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d Sep 08 14:04:28 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:28 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" returned: 0 in 0.230s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-quobyte-cab354d3-7d8d-4c65-9775-26bf86b4ad5d" released by "delete_volume" :: held 0.620s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Created reservations ['eb0d8e3e-3913-4c0c-917c-a883d5bbbd30', '2ee11608-e96f-4711-9fef-25c2ade02bf6', 'c9e26163-0de8-48bc-93ad-00d29fa6ae7a', '1daf95b1-8fb0-41f2-b153-9e737e25fb63'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:28 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:04:28 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:28 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.238s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:04:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Deleted volume successfully. Sep 08 14:04:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8ff61cef-b936-4aad-806e-948a2a8922e2 tempest-SnapshotDependencyTests-1979729819 None] Lock "cinder-cab354d3-7d8d-4c65-9775-26bf86b4ad5d-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:38 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=21,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:04:38 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=28,cinder:UPDATE=26,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Flow 'volume_create_manager' (7126f906-400e-4eae-81f0-2afef95b8682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4b5595-13cc-4174-a475-f7c6121c91e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4b5595-13cc-4174-a475-f7c6121c91e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1091211094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3b416d-f202-4762-bd61-126c5b8cea56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a64a1ddf0141459871717042fd2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:49Z,use_quota=True,user_id='a6bfed8f684149218b7435e2302d87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dca00bb-f16c-4036-8e9b-e80ccb6965ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dca00bb-f16c-4036-8e9b-e80ccb6965ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8f685a-cc06-4a12-93b6-bed90e874c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8f685a-cc06-4a12-93b6-bed90e874c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3b416d-f202-4762-bd61-126c5b8cea56', 'volume_name': 'volume-0b3b416d-f202-4762-bd61-126c5b8cea56', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cde70d-ea35-4854-9f4d-19111b7d556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cde70d-ea35-4854-9f4d-19111b7d556a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89abf7b-4b33-4493-811a-ddcd0e69467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Volume 0b3b416d-f202-4762-bd61-126c5b8cea56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3b416d-f202-4762-bd61-126c5b8cea56', 'volume_size': 1} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1091211094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3b416d-f202-4762-bd61-126c5b8cea56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a64a1ddf0141459871717042fd2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:49Z,use_quota=True,user_id='a6bfed8f684149218b7435e2302d87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Creating volume 0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:49 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:49 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 1073741824 Sep 08 14:04:49 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (58235930-e738-4ed3-b284-d4f1ce462639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a513a0c-2a23-4c29-a4d7-883750d046d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a513a0c-2a23-4c29-a4d7-883750d046d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1285476352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74ec5a-4d88-4f61-845e-1fdde61c5e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:49Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50664b5-3b64-4640-9fda-50f273663d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50664b5-3b64-4640-9fda-50f273663d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5c7cc8-a5c8-45ca-aed8-6f60503e1209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5c7cc8-a5c8-45ca-aed8-6f60503e1209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d74ec5a-4d88-4f61-845e-1fdde61c5e5b', 'volume_name': 'volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fbb454-4986-4b6f-a6f2-45a5c1465819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fbb454-4986-4b6f-a6f2-45a5c1465819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcfd01f-9d81-47a5-9b8f-d3ae7f7c1f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Volume 5d74ec5a-4d88-4f61-845e-1fdde61c5e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b', 'volume_size': 1} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (ceb16afa-320b-4cdd-8c5f-97f9d8ec77a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07196825-d0cc-417b-923c-8c5e3f279862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07196825-d0cc-417b-923c-8c5e3f279862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624501014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7077d850-4d0a-4264-90c4-4232ee7a0cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:50Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d58cfd-0870-436c-afdd-3eedb3fb832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d58cfd-0870-436c-afdd-3eedb3fb832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6eb39a-2426-4ea2-9409-965254c37db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6eb39a-2426-4ea2-9409-965254c37db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7077d850-4d0a-4264-90c4-4232ee7a0cba', 'volume_name': 'volume-7077d850-4d0a-4264-90c4-4232ee7a0cba', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa22cba5-decc-4d15-8322-f0469f70f84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa22cba5-decc-4d15-8322-f0469f70f84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2ca4cb-45f4-4276-92ac-9d9ef53157d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:49 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Volume 7077d850-4d0a-4264-90c4-4232ee7a0cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7077d850-4d0a-4264-90c4-4232ee7a0cba', 'volume_size': 1} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:49 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 1073741824" returned: 0 in 0.745s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:50 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 Sep 08 14:04:50 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (545074e5-9ebd-45bb-8764-ac8ae6ec870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28a6fad-f56b-4b32-b48e-ed3f3518b253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28a6fad-f56b-4b32-b48e-ed3f3518b253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196765814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b52eea0-3c71-4355-b2ad-ff64efb98405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:50Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f057f0-33cb-48c7-924f-170fe655e81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f057f0-33cb-48c7-924f-170fe655e81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54377d0e-daf1-4f6e-a363-00a6ae6f2f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54377d0e-daf1-4f6e-a363-00a6ae6f2f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b52eea0-3c71-4355-b2ad-ff64efb98405', 'volume_name': 'volume-2b52eea0-3c71-4355-b2ad-ff64efb98405', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4085dd03-1776-4026-8572-3779f9e87805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4085dd03-1776-4026-8572-3779f9e87805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d9c088-aecc-4e60-a956-d2843a57ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume 2b52eea0-3c71-4355-b2ad-ff64efb98405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b52eea0-3c71-4355-b2ad-ff64efb98405', 'volume_size': 1} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:50 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1285476352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74ec5a-4d88-4f61-845e-1fdde61c5e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:49Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Creating volume 5d74ec5a-4d88-4f61-845e-1fdde61c5e5b {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:50 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:50 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b 1073741824 Sep 08 14:04:50 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89abf7b-4b33-4493-811a-ddcd0e69467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3b416d-f202-4762-bd61-126c5b8cea56', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138410b7-cd2d-4c24-92e3-01c13014caea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Volume volume-0b3b416d-f202-4762-bd61-126c5b8cea56 (0b3b416d-f202-4762-bd61-126c5b8cea56): created successfully Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138410b7-cd2d-4c24-92e3-01c13014caea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Flow 'volume_create_manager' (7126f906-400e-4eae-81f0-2afef95b8682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (c523f3c5-326b-4641-be83-0cc85674dc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e02de4-d675-4cf5-985f-b50741d657e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-72a7f019-e23d-459d-88bf-e4cb1404da93 tempest-VolumeDependencyTests-777721739 None] Created volume successfully. Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e02de4-d675-4cf5-985f-b50741d657e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1065610565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465a2ba7-799e-4c66-8b51-00d3f0d1950d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:50Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf91169-6f0e-4c9c-a0da-eb19233b6bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf91169-6f0e-4c9c-a0da-eb19233b6bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88be658b-4f32-4df1-95c3-f765f213cf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88be658b-4f32-4df1-95c3-f765f213cf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '465a2ba7-799e-4c66-8b51-00d3f0d1950d', 'volume_name': 'volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb6bc61-6670-407c-8c69-06797688ad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb6bc61-6670-407c-8c69-06797688ad97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e208ed-ef2f-4a46-b079-41b321abae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Volume 465a2ba7-799e-4c66-8b51-00d3f0d1950d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d', 'volume_size': 1} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (e8d8191d-a505-43e4-a910-d53496a42f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7688bf4a-2278-4702-88b4-f64e8b54e19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7688bf4a-2278-4702-88b4-f64e8b54e19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-443626732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9fef20-76f7-4e7f-ac8c-95fada8bd192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:51Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97818722-b374-48c2-a872-a05a3ec15b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97818722-b374-48c2-a872-a05a3ec15b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ec775d-e0a1-4ff0-9653-a9b786f039a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ec775d-e0a1-4ff0-9653-a9b786f039a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9fef20-76f7-4e7f-ac8c-95fada8bd192', 'volume_name': 'volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c15d21-9f48-41d1-aaa0-c1004f2553a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c15d21-9f48-41d1-aaa0-c1004f2553a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b91c6a-bb34-4c19-beb1-c9bceb2a3c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Volume 8e9fef20-76f7-4e7f-ac8c-95fada8bd192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192', 'volume_size': 1} Sep 08 14:04:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:51 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b 1073741824" returned: 0 in 0.644s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:51 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b Sep 08 14:04:51 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (abbd166d-5b35-4016-bd1d-d91bba5a3b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270b6a14-1ee9-464d-b617-c1cfa2a4d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270b6a14-1ee9-464d-b617-c1cfa2a4d283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907584829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f64e6b4-5c09-4eda-b3b9-bf0611cf9529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:51Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be46333-49f4-419a-8273-ba9525c9ad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be46333-49f4-419a-8273-ba9525c9ad4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a2a681-1bc5-480d-84f5-893ee1934cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a2a681-1bc5-480d-84f5-893ee1934cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f64e6b4-5c09-4eda-b3b9-bf0611cf9529', 'volume_name': 'volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d8555d-51ae-46e7-8a31-fb96ab4db182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d8555d-51ae-46e7-8a31-fb96ab4db182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4dbc20-3fcf-4473-91c8-3f18b7bebbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:51 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Volume 4f64e6b4-5c09-4eda-b3b9-bf0611cf9529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529', 'volume_size': 1} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:51 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b" returned: 0 in 0.397s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.605s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624501014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7077d850-4d0a-4264-90c4-4232ee7a0cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:50Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Creating volume 7077d850-4d0a-4264-90c4-4232ee7a0cba {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:51 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:51 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba 1073741824 Sep 08 14:04:51 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcfd01f-9d81-47a5-9b8f-d3ae7f7c1f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f848ced7-08b6-46d4-91d2-eb759c884b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:51 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Volume volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b (5d74ec5a-4d88-4f61-845e-1fdde61c5e5b): created successfully Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f848ced7-08b6-46d4-91d2-eb759c884b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (58235930-e738-4ed3-b284-d4f1ce462639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ad4f26ea-5e8f-4eb6-830d-2453185d920f tempest-CreateVolumesFromImageTest-170070898 None] Created volume successfully. Sep 08 14:04:51 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba 1073741824" returned: 0 in 0.456s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:51 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba Sep 08 14:04:51 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:52 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba" returned: 0 in 0.274s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196765814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b52eea0-3c71-4355-b2ad-ff64efb98405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:50Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Creating volume 2b52eea0-3c71-4355-b2ad-ff64efb98405 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:52 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:52 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 1073741824 Sep 08 14:04:52 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2ca4cb-45f4-4276-92ac-9d9ef53157d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7077d850-4d0a-4264-90c4-4232ee7a0cba', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9bee51-0ea8-4521-b694-e6f74672bce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:52 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Volume volume-7077d850-4d0a-4264-90c4-4232ee7a0cba (7077d850-4d0a-4264-90c4-4232ee7a0cba): created successfully Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9bee51-0ea8-4521-b694-e6f74672bce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (ceb16afa-320b-4cdd-8c5f-97f9d8ec77a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:52 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-64e10557-0c87-413a-92b4-b3d89a870749 tempest-CreateVolumesFromImageTest-170070898 None] Created volume successfully. Sep 08 14:04:52 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 1073741824" returned: 0 in 0.478s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:52 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 Sep 08 14:04:52 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:53 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405" returned: 0 in 0.252s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1065610565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465a2ba7-799e-4c66-8b51-00d3f0d1950d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:50Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Creating volume 465a2ba7-799e-4c66-8b51-00d3f0d1950d {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:53 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d9c088-aecc-4e60-a956-d2843a57ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b52eea0-3c71-4355-b2ad-ff64efb98405', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afe69c5-c955-4312-8eac-23ff8f165bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:53 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d 1073741824 Sep 08 14:04:53 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:53 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 (2b52eea0-3c71-4355-b2ad-ff64efb98405): created successfully Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afe69c5-c955-4312-8eac-23ff8f165bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (545074e5-9ebd-45bb-8764-ac8ae6ec870e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:53 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-98c6eae1-cd85-4082-b71c-b6b2057739b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created volume successfully. Sep 08 14:04:53 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d 1073741824" returned: 0 in 0.679s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:53 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d Sep 08 14:04:53 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Flow 'volume_create_manager' (5c86c792-d1e4-40e6-bf84-a549cf04d5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e2ad30-d18f-4343-8b18-5f7abf1f6fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e2ad30-d18f-4343-8b18-5f7abf1f6fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0034c0-dd11-45ca-889e-5580d45c933d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48dd47a16c734aed96bcb0543bfddd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:54Z,use_quota=True,user_id='dc7247f1ce2e44c7a5cdfa9354d5d042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5914d609-15cd-4c63-9fa2-8c2124463c3d),volume_type_id=5914d609-15cd-4c63-9fa2-8c2124463c3d)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da677b94-88be-48cf-9e46-bf6c5a91ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da677b94-88be-48cf-9e46-bf6c5a91ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b810340-d9ad-4d5e-bd3c-f9b26dacbbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:53 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 14:04:54 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d" returned: 0 in 0.279s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.156s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-443626732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9fef20-76f7-4e7f-ac8c-95fada8bd192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:51Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Creating volume 8e9fef20-76f7-4e7f-ac8c-95fada8bd192 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:54 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:54 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 1073741824 Sep 08 14:04:54 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e208ed-ef2f-4a46-b079-41b321abae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02484476-1a57-4c81-869f-be117ea6bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:54 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Volume volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d (465a2ba7-799e-4c66-8b51-00d3f0d1950d): created successfully Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02484476-1a57-4c81-869f-be117ea6bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (c523f3c5-326b-4641-be83-0cc85674dc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-62bab5c2-9acb-40b3-acf9-e88d9951d6a0 tempest-CreateVolumesFromImageTest-170070898 None] Created volume successfully. Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b810340-d9ad-4d5e-bd3c-f9b26dacbbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a0034c0-dd11-45ca-889e-5580d45c933d', 'volume_name': 'volume-3a0034c0-dd11-45ca-889e-5580d45c933d', 'volume_size': 1, 'image_id': '4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '694c2c31f90e764156522249b1a801cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48dd47a16c734aed96bcb0543bfddd11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e4c4c7343e99ae294239367784ab348ad6de8c10fb60f46ff2af4ce5b4962237b5bf52da31a72309a5d747692fc2ddde78015a8010b36e5fee867413cd85b76', 'id': '4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'created_at': datetime.datetime(2026, 9, 8, 12, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 12, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cf4d4c-1b8a-41d1-bf75-fd693269ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cf4d4c-1b8a-41d1-bf75-fd693269ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e67c9ee-e115-4bef-9463-7d2655f193eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:54 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Volume 3a0034c0-dd11-45ca-889e-5580d45c933d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a0034c0-dd11-45ca-889e-5580d45c933d', 'volume_size': 1, 'image_id': '4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '694c2c31f90e764156522249b1a801cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48dd47a16c734aed96bcb0543bfddd11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e4c4c7343e99ae294239367784ab348ad6de8c10fb60f46ff2af4ce5b4962237b5bf52da31a72309a5d747692fc2ddde78015a8010b36e5fee867413cd85b76', 'id': '4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'created_at': datetime.datetime(2026, 9, 8, 12, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 12, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Trying to clone 3a0034c0-dd11-45ca-889e-5580d45c933d from image 4a1b1cd0-0087-458c-b547-9e0e1837ad48 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 14:04:54 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Image download 0.00 MB at 0.00 MB/s Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8731f90a-a50a-46f3-8165-36285c92bcb8]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:54 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD Sep 08 14:04:54 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:54 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 1073741824" returned: 0 in 0.458s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:54 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 Sep 08 14:04:54 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:54 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:54 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192" returned: 0 in 0.293s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.453s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907584829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f64e6b4-5c09-4eda-b3b9-bf0611cf9529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbc3a70feef42fda0c298d265e4e46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:51Z,use_quota=True,user_id='6908c544fcc341278c6899e3e3259e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Creating volume 4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:54 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b91c6a-bb34-4c19-beb1-c9bceb2a3c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:54 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 1073741824 Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccf4c9d-3e79-4a00-b7ec-971b66e390a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:54 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:54 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD Sep 08 14:04:54 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:54 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Volume volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 (8e9fef20-76f7-4e7f-ac8c-95fada8bd192): created successfully Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccf4c9d-3e79-4a00-b7ec-971b66e390a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (e8d8191d-a505-43e4-a910-d53496a42f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b11fdf71-4d5d-4471-bc70-5b27d26902e4 tempest-CreateVolumesFromImageTest-170070898 None] Created volume successfully. Sep 08 14:04:55 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Temporary image 4a1b1cd0-0087-458c-b547-9e0e1837ad48 is fetched for user dc7247f1ce2e44c7a5cdfa9354d5d042. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[396fc1b0-444e-49cf-b709-434ebd307da1]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:55 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 1073741824" returned: 0 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:55 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD Sep 08 14:04:55 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:55 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 Sep 08 14:04:55 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:55 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:55 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529" returned: 0 in 0.243s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.015s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4dbc20-3fcf-4473-91c8-3f18b7bebbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e406c78-f651-4d56-a27d-f7d76e384de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Creating offline snapshot e69cb66c-e659-425d-83ba-adedb0842a11 of volume 0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3483a4a-2aa0-4928-9266-b2f626765d5f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:55 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Volume volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 (4f64e6b4-5c09-4eda-b3b9-bf0611cf9529): created successfully Sep 08 14:04:55 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD Sep 08 14:04:55 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e406c78-f651-4d56-a27d-f7d76e384de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Flow 'volume_create_manager' (abbd166d-5b35-4016-bd1d-d91bba5a3b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-87bec0f5-e972-4f9d-847b-1cfa0b1d8e63 tempest-CreateVolumesFromImageTest-170070898 None] Created volume successfully. Sep 08 14:04:55 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 Sep 08 14:04:55 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-quobyte-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:55 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fca5d3a-632f-4b1a-b29e-0cce8a1db69c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:56 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56" returned: 0 in 0.402s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:56 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 Sep 08 14:04:56 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:56 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 1G Sep 08 14:04:56 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:56 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529" returned: 0 in 0.353s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:56 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529 Sep 08 14:04:56 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:56 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 1G" returned: 0 in 0.385s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3b416d-f202-4762-bd61-126c5b8cea56 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:56 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3b416d-f202-4762-bd61-126c5b8cea56 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 Sep 08 14:04:56 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:56 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529" returned: 0 in 0.246s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529" released by "delete_volume" :: held 0.641s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Created reservations ['b600f653-a2b4-4aa8-a500-97cd71f9469f', 'dc068bd2-f2d9-47e8-a29f-73cde0ce6369', '5ab1559d-5b20-4c65-8ba8-6127622e137a', 'b4ea3c68-b3eb-430c-a95b-03646fe0452b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:56 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:04:56 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:56 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3b416d-f202-4762-bd61-126c5b8cea56 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11" returned: 0 in 0.319s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:56 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 is being set with open permissions: ugo+rw Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:56 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 Sep 08 14:04:56 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:56 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.258s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:04:56 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Deleted volume successfully. Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-55ae02ad-915f-48d9-94d3-ffc69853651c tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-4f64e6b4-5c09-4eda-b3b9-bf0611cf9529-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:56 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11" returned: 0 in 0.248s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-8e9fef20-76f7-4e7f-ac8c-95fada8bd192-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:57 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.info Sep 08 14:04:57 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-8e9fef20-76f7-4e7f-ac8c-95fada8bd192-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-quobyte-8e9fef20-76f7-4e7f-ac8c-95fada8bd192" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-8e9fef20-76f7-4e7f-ac8c-95fada8bd192" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6087060-3913-401d-8fff-fb459b7ee39d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:57 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 Sep 08 14:04:57 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:57 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.info" returned: 0 in 0.299s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:57 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.info is being set with open permissions: ugo+rw Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:57 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.info Sep 08 14:04:57 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:57 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192" returned: 0 in 0.367s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:57 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192 Sep 08 14:04:57 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:57 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.info" returned: 0 in 0.239s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.725s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Creating offline snapshot e267bc28-5561-477a-881f-4ef954143f2b of volume 2b52eea0-3c71-4355-b2ad-ff64efb98405 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:04:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-16040f46-db3d-4781-bb92-39327b9ca025 tempest-VolumeDependencyTests-777721739 None] Create snapshot completed successfully Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ead1c79-55c7-437c-a7fe-c6dacf898037]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:57 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 Sep 08 14:04:57 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:57 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8e9fef20-76f7-4e7f-ac8c-95fada8bd192" returned: 0 in 0.276s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-8e9fef20-76f7-4e7f-ac8c-95fada8bd192" released by "delete_volume" :: held 0.694s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Created reservations ['06879b0b-b292-4c6b-95fb-63b818a32b75', '533a4e4c-41a7-4a87-aaef-212103699154', 'fe2568c6-57d9-4502-9808-a78f9c887a97', '95479b49-e02b-45e8-8379-2c1479a9713a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:57 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:04:57 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:58 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405" returned: 0 in 0.412s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:58 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b 1G Sep 08 14:04:58 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:58 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-465a2ba7-799e-4c66-8b51-00d3f0d1950d-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:58 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Deleted volume successfully. Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-465a2ba7-799e-4c66-8b51-00d3f0d1950d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c0e79d8a-cbda-4329-82fa-77bbb1761440 tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-8e9fef20-76f7-4e7f-ac8c-95fada8bd192-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-quobyte-465a2ba7-799e-4c66-8b51-00d3f0d1950d" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-465a2ba7-799e-4c66-8b51-00d3f0d1950d" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e05fd2-1c8d-4867-b16a-038d2d296eb3]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:04:58 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b 1G" returned: 0 in 0.520s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:58 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d Sep 08 14:04:58 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:58 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b Sep 08 14:04:58 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Flow 'volume_create_manager' (f3a8e6c7-33bf-4eba-b481-76b6ce33befa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea526ffc-eb5d-4864-a321-d7279b684534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea526ffc-eb5d-4864-a321-d7279b684534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1727596567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311feec8-4521-4380-8f94-d99bb32dcacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a64a1ddf0141459871717042fd2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e69cb66c-e659-425d-83ba-adedb0842a11,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:58Z,use_quota=True,user_id='a6bfed8f684149218b7435e2302d87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc05a5b4-c4de-4558-99b3-64ad43a94d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc05a5b4-c4de-4558-99b3-64ad43a94d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6586dcfc-0944-45e9-963e-777c1ebbe409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6586dcfc-0944-45e9-963e-777c1ebbe409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '311feec8-4521-4380-8f94-d99bb32dcacd', 'volume_name': 'volume-311feec8-4521-4380-8f94-d99bb32dcacd', 'volume_size': 1, 'snapshot_id': 'e69cb66c-e659-425d-83ba-adedb0842a11'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b507c4-36fd-4c21-b4d6-272df956596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b507c4-36fd-4c21-b4d6-272df956596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1f9f74-84fe-4c6a-bb60-e2eb3e1ead1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:04:58 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Volume 311feec8-4521-4380-8f94-d99bb32dcacd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-311feec8-4521-4380-8f94-d99bb32dcacd', 'volume_size': 1, 'snapshot_id': 'e69cb66c-e659-425d-83ba-adedb0842a11'} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:58 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d" returned: 0 in 0.425s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:58 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d Sep 08 14:04:58 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:58 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b" returned: 0 in 0.323s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:58 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b is being set with open permissions: ugo+rw Sep 08 14:04:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:58 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b Sep 08 14:04:58 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:59 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-465a2ba7-799e-4c66-8b51-00d3f0d1950d" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-465a2ba7-799e-4c66-8b51-00d3f0d1950d" released by "delete_volume" :: held 0.724s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:59 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b" returned: 0 in 0.256s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Created reservations ['af1d3e06-37c4-4500-b255-239d959c3b23', 'eed97278-d7d4-4d3d-b24b-4a5aea3aace8', '5ccb0408-8294-4eb3-b299-fc21d1c5e398', '5f2d1b51-c25f-49c7-a99d-8fcc2ac40877'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:59 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.info Sep 08 14:04:59 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:59 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:04:59 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:59 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.info" returned: 0 in 0.264s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:59 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.info is being set with open permissions: ugo+rw Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:59 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.info Sep 08 14:04:59 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-7077d850-4d0a-4264-90c4-4232ee7a0cba-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:59 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.277s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-7077d850-4d0a-4264-90c4-4232ee7a0cba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:59 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Deleted volume successfully. Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-2e0ec313-e84b-4cbf-a508-f157b8278c30 tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-465a2ba7-799e-4c66-8b51-00d3f0d1950d-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-quobyte-7077d850-4d0a-4264-90c4-4232ee7a0cba" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-7077d850-4d0a-4264-90c4-4232ee7a0cba" acquired by "delete_volume" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a873fdda-94f3-4a38-914d-c7dd08987e9d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:59 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.info" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:59 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba Sep 08 14:04:59 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.843s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0034c0-dd11-45ca-889e-5580d45c933d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48dd47a16c734aed96bcb0543bfddd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:04:54Z,use_quota=True,user_id='dc7247f1ce2e44c7a5cdfa9354d5d042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5914d609-15cd-4c63-9fa2-8c2124463c3d),volume_type_id=5914d609-15cd-4c63-9fa2-8c2124463c3d)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Creating volume 3a0034c0-dd11-45ca-889e-5580d45c933d {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:04:59 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:04:59 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d 1073741824 Sep 08 14:04:59 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:04:59 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cd6ea1bc-1588-401c-a502-46c2ad862fa8 tempest-CreateVolumesFromSnapshotTest-28203450 None] Create snapshot completed successfully Sep 08 14:04:59 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba" returned: 0 in 0.362s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:04:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:00 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba Sep 08 14:05:00 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:00 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d 1073741824" returned: 0 in 0.481s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:00 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-7077d850-4d0a-4264-90c4-4232ee7a0cba" returned: 0 in 0.269s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-7077d850-4d0a-4264-90c4-4232ee7a0cba" released by "delete_volume" :: held 0.675s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:00 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d Sep 08 14:05:00 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Created reservations ['c14c27fd-4541-4c11-b0ad-6e6db73f14ad', 'cc5d83a2-b820-4e8a-9501-cfd7f32fd8af', '84958d1e-968b-45c5-a699-b3e262dfea7b', '1db1dfc4-5864-4a4e-8d67-8848c4159a11'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:00 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:00 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:00 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d" returned: 0 in 0.288s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.914s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-quobyte-e69cb66c-e659-425d-83ba-adedb0842a11-311feec8-4521-4380-8f94-d99bb32dcacd" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-e69cb66c-e659-425d-83ba-adedb0842a11-311feec8-4521-4380-8f94-d99bb32dcacd" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Creating volume 311feec8-4521-4380-8f94-d99bb32dcacd from snapshot e69cb66c-e659-425d-83ba-adedb0842a11 {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-quobyte-311feec8-4521-4380-8f94-d99bb32dcacd" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Attempting download of 4a1b1cd0-0087-458c-b547-9e0e1837ad48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'metadata': {}}])) to volume 3a0034c0-dd11-45ca-889e-5580d45c933d. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-311feec8-4521-4380-8f94-d99bb32dcacd" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] snapshot: e69cb66c-e659-425d-83ba-adedb0842a11, volume: 311feec8-4521-4380-8f94-d99bb32dcacd, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:00 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5788893e-a75c-4d8f-a102-a51ab15ba04d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.346s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[669889b5-4849-4d4a-a5d2-215f3f8521ea]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a1b1cd0-0087-458c-b547-9e0e1837ad48_o6xjxyoc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Deleted volume successfully. Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (46f4a658-0ef1-4b2f-87d4-c6d2b7e234dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87ced12-26d1-4c68-ac40-cbb928195263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87ced12-26d1-4c68-ac40-cbb928195263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817661749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44e92f6-d602-4860-9939-2c4676bb4034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:01Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afe8859-25a0-4d36-a983-35263aae9205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afe8859-25a0-4d36-a983-35263aae9205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e4e8c7-3e23-4fe2-b3fd-5206f3414ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e4e8c7-3e23-4fe2-b3fd-5206f3414ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e44e92f6-d602-4860-9939-2c4676bb4034', 'volume_name': 'volume-e44e92f6-d602-4860-9939-2c4676bb4034', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:00 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 Sep 08 14:05:00 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:00 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a1b1cd0-0087-458c-b547-9e0e1837ad48_o6xjxyoc Sep 08 14:05:00 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419bc86b-a3b4-4132-b8de-a93c02337c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419bc86b-a3b4-4132-b8de-a93c02337c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a47ab8c-e7ab-463a-a469-5c6e4176ccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume e44e92f6-d602-4860-9939-2c4676bb4034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e44e92f6-d602-4860-9939-2c4676bb4034', 'volume_size': 1} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-acc85935-4bdd-49cb-84cc-3b7a2c96604b tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-7077d850-4d0a-4264-90c4-4232ee7a0cba-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "cinder-quobyte-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b" acquired by "delete_volume" :: waited 0.039s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c5f22-27e1-4655-a760-52c972766ee7]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:01 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (7d9e05a8-b171-4ea8-919d-5a7d0fc3c484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce38430-61fb-497f-ab97-a75ad3d82937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a1b1cd0-0087-458c-b547-9e0e1837ad48_o6xjxyoc" returned: 0 in 0.464s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a1b1cd0-0087-458c-b547-9e0e1837ad48_o6xjxyoc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce38430-61fb-497f-ab97-a75ad3d82937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529170391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16346e5d-0b62-4a49-ad1b-9c7659cc6aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:01Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:01 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b Sep 08 14:05:01 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126ba8c0-6639-43c7-85be-add1097b47b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126ba8c0-6639-43c7-85be-add1097b47b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0166fe-137b-4949-82b5-ba5e9bcf8db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0166fe-137b-4949-82b5-ba5e9bcf8db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16346e5d-0b62-4a49-ad1b-9c7659cc6aeb', 'volume_name': 'volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079cc62d-42e0-47ce-953b-2a7340ce89b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079cc62d-42e0-47ce-953b-2a7340ce89b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf681156-2372-40e7-b264-887ff218ea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume 16346e5d-0b62-4a49-ad1b-9c7659cc6aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb', 'volume_size': 1} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:01 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11" returned: 0 in 0.638s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b3b416d-f202-4762-bd61-126c5b8cea56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[121e8853-4546-4622-88d4-a66aa9c78228]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:01 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a1b1cd0-0087-458c-b547-9e0e1837ad48_o6xjxyoc Sep 08 14:05:01 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:01 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 Sep 08 14:05:01 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:01 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b" returned: 0 in 0.599s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:01 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a1b1cd0-0087-458c-b547-9e0e1837ad48_o6xjxyoc" returned: 1 in 0.493s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a1b1cd0-0087-458c-b547-9e0e1837ad48_o6xjxyoc' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d445d-6e61-43dc-8adc-dda0be676e20]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:01 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b Sep 08 14:05:01 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (1e9fa9cf-f139-44bf-9935-3413cbeabf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4f7bf1-78e4-42be-924e-8893b2122bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4f7bf1-78e4-42be-924e-8893b2122bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-547235124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0073dfd3-1655-43a0-94f2-3083e8e1f19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:02Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:01 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ba936c-09ee-4628-8c8f-589e6f5f5c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:01 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD Sep 08 14:05:01 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ba936c-09ee-4628-8c8f-589e6f5f5c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:02 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25de950f-cc72-470a-9d80-d1075bc14b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25de950f-cc72-470a-9d80-d1075bc14b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0073dfd3-1655-43a0-94f2-3083e8e1f19c', 'volume_name': 'volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed715ae-4de8-4e4b-91f7-742cd6e8f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed715ae-4de8-4e4b-91f7-742cd6e8f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb051303-d364-44eb-b7f5-a1941eb165f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:02 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume 0073dfd3-1655-43a0-94f2-3083e8e1f19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c', 'volume_size': 1} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56" returned: 0 in 0.621s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:02 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd Sep 08 14:05:02 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:02 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b" returned: 0 in 0.423s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-quobyte-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b" released by "delete_volume" :: held 1.096s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:02 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Created reservations ['191205fb-d474-41b6-a731-5895c25ed083', 'e61fabc5-c3c7-46b6-adf9-ff43d044dfb8', '039282a1-74ea-43f5-9331-9f9462b53cd4', '8a00d184-fdbf-4cc6-b4f9-e32ceb8fb7c9'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (bff66198-b385-476e-85b0-118a909db9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636eae3f-8559-4821-bce0-425cd01877d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:02 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD Sep 08 14:05:02 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636eae3f-8559-4821-bce0-425cd01877d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1786350579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f594b65f-2e29-4530-8a14-e51d81de965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:02Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15a976e-5e93-42bd-af81-5e4a1a06cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15a976e-5e93-42bd-af81-5e4a1a06cae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554e3529-bdfa-4972-bb7f-713cfe88fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554e3529-bdfa-4972-bb7f-713cfe88fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f594b65f-2e29-4530-8a14-e51d81de965f', 'volume_name': 'volume-f594b65f-2e29-4530-8a14-e51d81de965f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6742e2ec-2a6a-416a-9dda-270d2fc2b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6742e2ec-2a6a-416a-9dda-270d2fc2b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dff48e-ab33-4661-99d0-07881520a625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:02 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume f594b65f-2e29-4530-8a14-e51d81de965f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f594b65f-2e29-4530-8a14-e51d81de965f', 'volume_size': 1} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:02 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:02 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:02 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD" returned: 1 in 0.471s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] 4a1b1cd0-0087-458c-b547-9e0e1837ad48 was raw, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 14:05:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:02 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d Sep 08 14:05:02 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:03 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:03 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:03 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.791s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:03 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Deleted volume successfully. Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (04302c35-3c87-4e6a-9f77-8a4a60f12d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecc6cdc-2924-408d-90ee-00f11b63c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecc6cdc-2924-408d-90ee-00f11b63c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1600067717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:03Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca78397-e45e-43fd-8d81-c03011448db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca78397-e45e-43fd-8d81-c03011448db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90239ec7-4871-4541-9450-5be0756d804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90239ec7-4871-4541-9450-5be0756d804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa', 'volume_name': 'volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d08e55-1e24-4f92-aba0-f7cb912cc910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d08e55-1e24-4f92-aba0-f7cb912cc910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fd0bea-12f8-4530-8ae9-0a87382f7049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:03 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa', 'volume_size': 1} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-78084725-75c2-4f5f-9393-f3a84c8b621a tempest-CreateVolumesFromImageTest-170070898 None] Lock "cinder-5d74ec5a-4d88-4f61-845e-1fdde61c5e5b-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:03 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d" returned: 0 in 1.095s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a1b1cd0-0087-458c-b547-9e0e1837ad48_53fegwtddevstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:05:03 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:03 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d 1G Sep 08 14:05:03 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:03 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.767s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:05:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 14:05:04 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d 1G" returned: 0 in 0.739s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Downloaded image 4a1b1cd0-0087-458c-b547-9e0e1837ad48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'metadata': {}}])) to volume 3a0034c0-dd11-45ca-889e-5580d45c933d successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Temporary image 4a1b1cd0-0087-458c-b547-9e0e1837ad48 for user dc7247f1ce2e44c7a5cdfa9354d5d042 is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Marking volume 3a0034c0-dd11-45ca-889e-5580d45c933d as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Copying metadata from image 4a1b1cd0-0087-458c-b547-9e0e1837ad48 to 3a0034c0-dd11-45ca-889e-5580d45c933d. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Creating volume glance metadata for volume 3a0034c0-dd11-45ca-889e-5580d45c933d backed by image 4a1b1cd0-0087-458c-b547-9e0e1837ad48 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '694c2c31f90e764156522249b1a801cd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e67c9ee-e115-4bef-9463-7d2655f193eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0034c0-dd11-45ca-889e-5580d45c933d', 'volume_size': 1, 'image_id': '4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '694c2c31f90e764156522249b1a801cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48dd47a16c734aed96bcb0543bfddd11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e4c4c7343e99ae294239367784ab348ad6de8c10fb60f46ff2af4ce5b4962237b5bf52da31a72309a5d747692fc2ddde78015a8010b36e5fee867413cd85b76', 'id': '4a1b1cd0-0087-458c-b547-9e0e1837ad48', 'created_at': datetime.datetime(2026, 9, 8, 12, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 12, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a1b1cd0-0087-458c-b547-9e0e1837ad48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efe3d99-1f6f-46b0-acfb-187cfdd47313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:04 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Volume volume-3a0034c0-dd11-45ca-889e-5580d45c933d (3a0034c0-dd11-45ca-889e-5580d45c933d): created successfully Sep 08 14:05:04 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efe3d99-1f6f-46b0-acfb-187cfdd47313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:05 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Flow 'volume_create_manager' (5c86c792-d1e4-40e6-bf84-a549cf04d5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-19c899ae-1670-482d-aa48-6298b0a6cff8 tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Created volume successfully. Sep 08 14:05:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Acquiring lock "cinder-3a0034c0-dd11-45ca-889e-5580d45c933d-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "cinder-3a0034c0-dd11-45ca-889e-5580d45c933d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Acquiring lock "cinder-quobyte-3a0034c0-dd11-45ca-889e-5580d45c933d" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "cinder-quobyte-3a0034c0-dd11-45ca-889e-5580d45c933d" acquired by "delete_volume" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac46aee-661b-467e-8b31-4bffc3349ebf]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:06 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d Sep 08 14:05:06 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:07 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d" returned: 0 in 1.015s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:07 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d Sep 08 14:05:07 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:07 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd" returned: 0 in 5.601s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:05:07 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Converted 1024.00 MB image at 182.77 MB/s Sep 08 14:05:07 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd is being set with open permissions: ugo+rw Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:07 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd Sep 08 14:05:07 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:07 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-3a0034c0-dd11-45ca-889e-5580d45c933d" returned: 0 in 0.400s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "cinder-quobyte-3a0034c0-dd11-45ca-889e-5580d45c933d" released by "delete_volume" :: held 1.491s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Created reservations ['0add3d06-ee2c-43ad-8fbd-0b314d989a3a', 'a694819e-2589-4c9e-aeb9-0f2db3fd44bc', '170c8cca-e11a-4264-8226-76e85aa1b8e3', '3c8f25ce-77db-4294-b779-adb49d79188d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:07 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd" returned: 0 in 0.254s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-311feec8-4521-4380-8f94-d99bb32dcacd" released by "_copy_volume_from_snapshot" :: held 7.258s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-e69cb66c-e659-425d-83ba-adedb0842a11-311feec8-4521-4380-8f94-d99bb32dcacd" released by "_create_volume_from_snapshot" :: held 7.369s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.411s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.986s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817661749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44e92f6-d602-4860-9939-2c4676bb4034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:01Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Creating volume e44e92f6-d602-4860-9939-2c4676bb4034 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:08 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:08 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:08 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:08 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 1073741824 Sep 08 14:05:08 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1f9f74-84fe-4c6a-bb60-e2eb3e1ead1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311feec8-4521-4380-8f94-d99bb32dcacd', 'volume_size': 1, 'snapshot_id': 'e69cb66c-e659-425d-83ba-adedb0842a11'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d0a2b2-66db-4c5c-892a-2996ba3184fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:08 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Volume volume-311feec8-4521-4380-8f94-d99bb32dcacd (311feec8-4521-4380-8f94-d99bb32dcacd): created successfully Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d0a2b2-66db-4c5c-892a-2996ba3184fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Flow 'volume_create_manager' (f3a8e6c7-33bf-4eba-b481-76b6ce33befa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-de6277b1-324b-4205-a4e8-ad076ea5b60e tempest-VolumeDependencyTests-777721739 None] Created volume successfully. Sep 08 14:05:08 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.307s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Deleted volume successfully. Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ec34c2ec-8c63-4d9a-bf1b-8f1a1340d5aa tempest-VolumeAndVolumeTypeFromImageTest-110359247 None] Lock "cinder-3a0034c0-dd11-45ca-889e-5580d45c933d-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:08 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 1073741824" returned: 0 in 0.451s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:08 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 Sep 08 14:05:08 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-e69cb66c-e659-425d-83ba-adedb0842a11-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Lock "cinder-e69cb66c-e659-425d-83ba-adedb0842a11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-quobyte-0b3b416d-f202-4762-bd61-126c5b8cea56" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-0b3b416d-f202-4762-bd61-126c5b8cea56" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-quobyte-e69cb66c-e659-425d-83ba-adedb0842a11" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-e69cb66c-e659-425d-83ba-adedb0842a11" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Deleting offline snapshot e69cb66c-e659-425d-83ba-adedb0842a11 of volume 0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] snapshot_file for this snap is: volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[1433cb58-88c9-4a5a-b6db-5c278bcf45c6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:08 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034" returned: 0 in 0.341s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.494s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529170391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16346e5d-0b62-4a49-ad1b-9c7659cc6aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:01Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Creating volume 16346e5d-0b62-4a49-ad1b-9c7659cc6aeb {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:08 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a47ab8c-e7ab-463a-a469-5c6e4176ccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44e92f6-d602-4860-9939-2c4676bb4034', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:08 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb 1073741824 Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b521a08-6c29-4e68-b044-7166fb8c6fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:08 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:08 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume volume-e44e92f6-d602-4860-9939-2c4676bb4034 (e44e92f6-d602-4860-9939-2c4676bb4034): created successfully Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b521a08-6c29-4e68-b044-7166fb8c6fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (46f4a658-0ef1-4b2f-87d4-c6d2b7e234dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-6c6de06d-1321-41f1-8491-fbd62e8ddd63 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created volume successfully. Sep 08 14:05:09 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 Sep 08 14:05:09 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (953dd682-e18e-4b78-8506-3149bb4f3348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddf2997-5213-4928-890e-3f453e77b944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddf2997-5213-4928-890e-3f453e77b944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-667599269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486722a7-d6b1-4145-bc9f-b6d7ba03125d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:09Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8143b78-b86b-4cb8-bf6c-0928187bef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8143b78-b86b-4cb8-bf6c-0928187bef4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798ae286-8383-45cc-b722-dce6207d1ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798ae286-8383-45cc-b722-dce6207d1ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486722a7-d6b1-4145-bc9f-b6d7ba03125d', 'volume_name': 'volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678cbbd5-ea50-4d05-b9a5-9edab7450acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678cbbd5-ea50-4d05-b9a5-9edab7450acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ab1a4e-f8cb-400b-b004-3ca963ded023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:09 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume 486722a7-d6b1-4145-bc9f-b6d7ba03125d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d', 'volume_size': 1} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:09 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11" returned: 0 in 0.488s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b3b416d-f202-4762-bd61-126c5b8cea56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabc6600-ffcc-4ee3-9ae7-27f63557b3cc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:09 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb 1073741824" returned: 0 in 0.526s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:09 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 Sep 08 14:05:09 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:09 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb Sep 08 14:05:09 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:09 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb" returned: 0 in 0.254s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.646s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-547235124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0073dfd3-1655-43a0-94f2-3083e8e1f19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:02Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Creating volume 0073dfd3-1655-43a0-94f2-3083e8e1f19c {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:09 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf681156-2372-40e7-b264-887ff218ea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d126a012-1db7-44e5-8d28-e366c5b780e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:09 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c 1073741824 Sep 08 14:05:09 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:09 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb (16346e5d-0b62-4a49-ad1b-9c7659cc6aeb): created successfully Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d126a012-1db7-44e5-8d28-e366c5b780e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (7d9e05a8-b171-4ea8-919d-5a7d0fc3c484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:09 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b1bfd736-bae9-4bfe-9dfa-01954156f0b1 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created volume successfully. Sep 08 14:05:09 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56" returned: 0 in 0.646s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:10 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 Sep 08 14:05:10 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:10 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c 1073741824" returned: 0 in 0.524s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:10 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c Sep 08 14:05:10 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:10 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11" returned: 0 in 0.375s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:10 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11 Sep 08 14:05:10 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:10 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.093s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1786350579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f594b65f-2e29-4530-8a14-e51d81de965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:02Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Creating volume f594b65f-2e29-4530-8a14-e51d81de965f {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:10 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:10 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f 1073741824 Sep 08 14:05:10 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb051303-d364-44eb-b7f5-a1941eb165f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf2948b-f4c6-4f4e-b873-797febe6f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:10 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c (0073dfd3-1655-43a0-94f2-3083e8e1f19c): created successfully Sep 08 14:05:10 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf2948b-f4c6-4f4e-b873-797febe6f032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (1e9fa9cf-f139-44bf-9935-3413cbeabf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56.e69cb66c-e659-425d-83ba-adedb0842a11" returned: 0 in 0.323s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-02e2407f-331a-4e66-82bc-c2424c179b32 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created volume successfully. Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-e69cb66c-e659-425d-83ba-adedb0842a11" released by "_delete_snapshot" :: held 1.966s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-0b3b416d-f202-4762-bd61-126c5b8cea56" released by "delete_snapshot" :: held 2.046s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Created reservations ['949a647c-479b-489c-be33-1d02a0e3561d', '095807dc-f41d-4e38-9220-252f5297bb8e', 'd501242e-7f88-4282-9814-bda52495fc9f', '0a8dc845-a885-4449-a917-800056786979'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Delete snapshot completed successfully. Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4977804-aa09-4103-bbb4-17388b2bade6 tempest-VolumeDependencyTests-777721739 None] Lock "cinder-e69cb66c-e659-425d-83ba-adedb0842a11-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-0b3b416d-f202-4762-bd61-126c5b8cea56-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Lock "cinder-0b3b416d-f202-4762-bd61-126c5b8cea56-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-quobyte-0b3b416d-f202-4762-bd61-126c5b8cea56" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-0b3b416d-f202-4762-bd61-126c5b8cea56" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[276239e7-b6e0-4396-8939-9655c6fa8dbd]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:11 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f 1073741824" returned: 0 in 0.605s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:11 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f Sep 08 14:05:11 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:11 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 Sep 08 14:05:11 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:11 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f" returned: 0 in 0.293s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.893s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1600067717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe479b5809c4f87b650060692a774bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:03Z,use_quota=True,user_id='5837fd0be4824363aed1b1f161c283cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Creating volume f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:11 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:11 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dff48e-ab33-4661-99d0-07881520a625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f594b65f-2e29-4530-8a14-e51d81de965f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:11 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa 1073741824 Sep 08 14:05:11 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdc5040-b37b-469b-b8f5-6ace470e7880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:11 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume volume-f594b65f-2e29-4530-8a14-e51d81de965f (f594b65f-2e29-4530-8a14-e51d81de965f): created successfully Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdc5040-b37b-469b-b8f5-6ace470e7880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (bff66198-b385-476e-85b0-118a909db9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:11 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56 Sep 08 14:05:11 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4e1d8cdb-d31b-49a3-9003-18c9158676e6 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created volume successfully. Sep 08 14:05:11 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0b3b416d-f202-4762-bd61-126c5b8cea56" returned: 0 in 0.306s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-0b3b416d-f202-4762-bd61-126c5b8cea56" released by "delete_volume" :: held 0.816s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:11 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Created reservations ['f25c0201-1277-4726-a257-e2abb41b5b83', '3025a46b-e46d-4272-9959-0349e28df392', '6af73e61-9976-4cc2-9b6b-072741ac71a0', '1d0913ca-d1b4-49ae-86d9-de72b152e8e0'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:12 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:12 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:12 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa 1073741824" returned: 0 in 0.567s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:12 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa Sep 08 14:05:12 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-311feec8-4521-4380-8f94-d99bb32dcacd-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Lock "cinder-311feec8-4521-4380-8f94-d99bb32dcacd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Acquiring lock "cinder-quobyte-311feec8-4521-4380-8f94-d99bb32dcacd" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-311feec8-4521-4380-8f94-d99bb32dcacd" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:12 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.433s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0aa11d-70e6-446c-b555-97fe268a4087]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:12 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:12 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Deleted volume successfully. Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa" returned: 0 in 0.346s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.383s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-667599269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486722a7-d6b1-4145-bc9f-b6d7ba03125d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:09Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Creating volume 486722a7-d6b1-4145-bc9f-b6d7ba03125d {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:12 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a987cb0a-96d8-4ab9-9fb2-3047f873208a tempest-VolumeDependencyTests-777721739 None] Lock "cinder-0b3b416d-f202-4762-bd61-126c5b8cea56-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:12 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d 1073741824 Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fd0bea-12f8-4530-8ae9-0a87382f7049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:12 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560f992d-f2ac-4bb0-9fa0-c9dcf84caefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Volume volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa (f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa): created successfully Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560f992d-f2ac-4bb0-9fa0-c9dcf84caefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Flow 'volume_create_manager' (04302c35-3c87-4e6a-9f77-8a4a60f12d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:12 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd Sep 08 14:05:12 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:12 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-53bcbf51-cad4-4b6e-bf56-2ee9cc42a518 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created volume successfully. Sep 08 14:05:12 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd" returned: 0 in 0.410s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:12 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd Sep 08 14:05:12 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:13 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d 1073741824" returned: 0 in 0.508s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:13 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d Sep 08 14:05:13 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:13 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-311feec8-4521-4380-8f94-d99bb32dcacd" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Lock "cinder-quobyte-311feec8-4521-4380-8f94-d99bb32dcacd" released by "delete_volume" :: held 0.759s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Created reservations ['54582914-1b43-4707-ac2a-ad9e5bb916d8', '52f76cb8-d4d1-4776-bd70-b5f5a9a685ea', 'e40579c1-e2bd-44ea-b640-f4fc66f77ba4', 'fccdede3-3be5-4f9a-812c-8c1b8fac7a7c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:13 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d" returned: 0 in 0.311s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:13 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:13 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ab1a4e-f8cb-400b-b004-3ca963ded023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c696bd-02d6-48fb-aae3-07eb188d3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:13 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d (486722a7-d6b1-4145-bc9f-b6d7ba03125d): created successfully Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c696bd-02d6-48fb-aae3-07eb188d3807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (953dd682-e18e-4b78-8506-3149bb4f3348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0638dcbf-0e42-488c-896e-942347ee8c24 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created volume successfully. Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-quobyte-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdf787d-c20d-4839-8760-2024cd85fa46]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:13 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.358s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Deleted volume successfully. Sep 08 14:05:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4110ac3-bba8-4d3d-8e2b-26aa34073fcc tempest-VolumeDependencyTests-777721739 None] Lock "cinder-311feec8-4521-4380-8f94-d99bb32dcacd-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:13 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa Sep 08 14:05:13 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:14 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa" returned: 0 in 0.417s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:14 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa Sep 08 14:05:14 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:14 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa" returned: 0 in 0.341s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa" released by "delete_volume" :: held 0.825s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created reservations ['d339d082-2628-487b-9598-6d6863c5478c', 'eec3f2f3-4fad-446b-8fd6-b0c387490861', '28996377-bf57-41d7-af57-c1570d6c69dc', 'e97de788-55b2-4976-976c-0cda08d83310'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:14 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:14 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-f594b65f-2e29-4530-8a14-e51d81de965f-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-f594b65f-2e29-4530-8a14-e51d81de965f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-quobyte-f594b65f-2e29-4530-8a14-e51d81de965f" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-f594b65f-2e29-4530-8a14-e51d81de965f" acquired by "delete_volume" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a2e5e8-e402-4b1a-940d-eb4add1a75d5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:15 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (8a1a6206-ee79-43a5-b786-5637857ca300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe461b4-5371-40d7-8635-d8339008d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Deleted volume successfully. Sep 08 14:05:15 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f Sep 08 14:05:15 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe461b4-5371-40d7-8635-d8339008d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-504932208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583ed8f5-4884-4665-8155-e67768705030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:15Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f480b2-cd7a-450f-bdb0-11f91fc812b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f480b2-cd7a-450f-bdb0-11f91fc812b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78397eef-06b5-4b2e-9a3f-a6ab14b48d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78397eef-06b5-4b2e-9a3f-a6ab14b48d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583ed8f5-4884-4665-8155-e67768705030', 'volume_name': 'volume-583ed8f5-4884-4665-8155-e67768705030', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd62ca3-3558-4b67-83b8-3bb0c4994269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd62ca3-3558-4b67-83b8-3bb0c4994269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fad3ca-bb87-44b8-b601-3085a831dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:15 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume 583ed8f5-4884-4665-8155-e67768705030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583ed8f5-4884-4665-8155-e67768705030', 'volume_size': 1} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-504932208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583ed8f5-4884-4665-8155-e67768705030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:15Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Creating volume 583ed8f5-4884-4665-8155-e67768705030 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:15 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c4c1c0ea-a0b7-4524-989e-edafdb888770 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-f5cfcf67-b63d-40e9-9e6f-1e1cd84cceaa-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:15 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 1073741824 Sep 08 14:05:15 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:15 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f" returned: 0 in 0.537s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:15 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f Sep 08 14:05:15 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:15 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 1073741824" returned: 0 in 0.685s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:15 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (ff5d591b-7e7b-4ae3-a887-322017164604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8292974e-5c8f-4d4d-94c6-df319a173724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f594b65f-2e29-4530-8a14-e51d81de965f" returned: 0 in 0.495s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8292974e-5c8f-4d4d-94c6-df319a173724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382691416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bee6a4-ee89-46c7-974f-ea15da28ae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:16Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a226dc6f-27dc-4cf7-b1a6-6c63b3602818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a226dc6f-27dc-4cf7-b1a6-6c63b3602818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247db8e4-c21d-4db0-9804-e0bcd97b61f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247db8e4-c21d-4db0-9804-e0bcd97b61f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bee6a4-ee89-46c7-974f-ea15da28ae33', 'volume_name': 'volume-38bee6a4-ee89-46c7-974f-ea15da28ae33', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903173d4-2138-4a81-b0d7-ca716895c7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903173d4-2138-4a81-b0d7-ca716895c7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d53902a-9475-4992-a914-b51b30c91648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume 38bee6a4-ee89-46c7-974f-ea15da28ae33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bee6a4-ee89-46c7-974f-ea15da28ae33', 'volume_size': 1} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-f594b65f-2e29-4530-8a14-e51d81de965f" released by "delete_volume" :: held 1.132s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:16 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 Sep 08 14:05:16 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Created reservations ['7dc4671b-2933-4222-888f-e6002de14f81', 'c2a8cc74-7233-4139-88d0-a1a42fc8a4f8', 'b3a77e37-7200-4a01-a88a-19aec6e566ef', '03ae9929-cd26-4f61-a842-e8941309a07f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:16 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:16 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:16 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030" returned: 0 in 0.372s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382691416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bee6a4-ee89-46c7-974f-ea15da28ae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:16Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Creating volume 38bee6a4-ee89-46c7-974f-ea15da28ae33 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:16 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fad3ca-bb87-44b8-b601-3085a831dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583ed8f5-4884-4665-8155-e67768705030', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:16 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 1073741824 Sep 08 14:05:16 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8880148d-3c74-4126-bde0-85e2bf1b62f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume volume-583ed8f5-4884-4665-8155-e67768705030 (583ed8f5-4884-4665-8155-e67768705030): created successfully Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8880148d-3c74-4126-bde0-85e2bf1b62f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (8a1a6206-ee79-43a5-b786-5637857ca300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (c4d5f627-b1c5-49a6-aa31-e868f0e6704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:16 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539cc1db-aed4-450c-8d3f-0f87b0a94aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.463s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:16 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-eacae71d-b850-456f-9c98-ef6047cfd00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created volume successfully. Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:16 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Deleted volume successfully. Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539cc1db-aed4-450c-8d3f-0f87b0a94aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-981145923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6c0d76-3bf4-4630-a857-4dc2145a20f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:16Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc2999f-e812-486e-bb6e-046bc77e0f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc2999f-e812-486e-bb6e-046bc77e0f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626828e1-be71-43aa-8b56-18c31ad363a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626828e1-be71-43aa-8b56-18c31ad363a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6c0d76-3bf4-4630-a857-4dc2145a20f0', 'volume_name': 'volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b390c2f6-7e99-4a38-9f6d-c1f0beff709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b390c2f6-7e99-4a38-9f6d-c1f0beff709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc220d0-d933-46d3-8f52-fa0d8cfc4b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:16 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume 8b6c0d76-3bf4-4630-a857-4dc2145a20f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0', 'volume_size': 1} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-25c123ed-f611-491b-8ac3-838cac20b89a tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-f594b65f-2e29-4530-8a14-e51d81de965f-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:17 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 1073741824" returned: 0 in 0.723s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-0073dfd3-1655-43a0-94f2-3083e8e1f19c-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-0073dfd3-1655-43a0-94f2-3083e8e1f19c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:17 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 Sep 08 14:05:17 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-quobyte-0073dfd3-1655-43a0-94f2-3083e8e1f19c" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-0073dfd3-1655-43a0-94f2-3083e8e1f19c" acquired by "delete_volume" :: waited 0.042s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3925c15-8750-42c7-98cf-4e49cff6083f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:17 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33" returned: 0 in 0.303s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-981145923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6c0d76-3bf4-4630-a857-4dc2145a20f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:16Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Creating volume 8b6c0d76-3bf4-4630-a857-4dc2145a20f0 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:17 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c Sep 08 14:05:17 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:17 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:17 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 1073741824 Sep 08 14:05:17 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d53902a-9475-4992-a914-b51b30c91648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bee6a4-ee89-46c7-974f-ea15da28ae33', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30cb8d6-da71-419e-bf52-49b353bc8fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:17 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 (38bee6a4-ee89-46c7-974f-ea15da28ae33): created successfully Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30cb8d6-da71-419e-bf52-49b353bc8fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (ff5d591b-7e7b-4ae3-a887-322017164604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (733fc099-8bcf-44fc-8d12-73064bfb4107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89214a02-8526-4130-8189-9f26f2e21192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:17 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e94585f5-2e41-4735-b9cb-42a805c3c6ef tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created volume successfully. Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89214a02-8526-4130-8189-9f26f2e21192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172301789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084b9f48-84a2-4a78-988c-125219a0492f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:18Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4e008e-13e8-4f3b-850b-23c09ed00efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4e008e-13e8-4f3b-850b-23c09ed00efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebc1a99-9ac3-48d3-b737-d4cc2f1975f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebc1a99-9ac3-48d3-b737-d4cc2f1975f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084b9f48-84a2-4a78-988c-125219a0492f', 'volume_name': 'volume-084b9f48-84a2-4a78-988c-125219a0492f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b02c4b-0b01-49a4-ac1d-30e0164603e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b02c4b-0b01-49a4-ac1d-30e0164603e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696e6f7b-7f30-4286-9cc8-9ae837118e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:17 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume 084b9f48-84a2-4a78-988c-125219a0492f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084b9f48-84a2-4a78-988c-125219a0492f', 'volume_size': 1} Sep 08 14:05:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (d229d6bb-4619-4b4d-af5c-c81e9b9126d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50200872-4204-4fee-ad26-e6fa2d58ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:18 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c" returned: 0 in 0.629s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:18 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c Sep 08 14:05:18 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50200872-4204-4fee-ad26-e6fa2d58ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317909558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64feb6f2-220f-48d7-bca3-aec5c63aa58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:18Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f4f07e-84b6-4081-bd38-7f1c207eb289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f4f07e-84b6-4081-bd38-7f1c207eb289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8349e09-7071-4002-8bba-1555304e1d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8349e09-7071-4002-8bba-1555304e1d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64feb6f2-220f-48d7-bca3-aec5c63aa58a', 'volume_name': 'volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5144e089-d683-42b8-a86f-40066aa2dd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5144e089-d683-42b8-a86f-40066aa2dd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd540ac-c914-4513-9cd0-8998d57c8a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:18 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume 64feb6f2-220f-48d7-bca3-aec5c63aa58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a', 'volume_size': 1} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:18 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 1073741824" returned: 0 in 0.606s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:18 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 Sep 08 14:05:18 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:18 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-0073dfd3-1655-43a0-94f2-3083e8e1f19c" returned: 0 in 0.343s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-f9db08c3-bf7e-4a03-b0d9-85d53b3386bb tempest-ProjectAdminTests-1615661016 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5277214050293, 'free_capacity_gb': 1773.5277214050293, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87262) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-0073dfd3-1655-43a0-94f2-3083e8e1f19c" released by "delete_volume" :: held 1.035s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Created reservations ['76ab5221-8de3-4fd3-aefd-42c3c3825cf9', 'da7021a6-fab6-4521-95b3-b78b6524879d', '604261b2-e291-460d-bcef-0c329f94aae6', 'a61ae30c-9537-44a2-b7c4-e5329e231104'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:18 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0" returned: 0 in 0.341s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172301789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084b9f48-84a2-4a78-988c-125219a0492f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:18Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Creating volume 084b9f48-84a2-4a78-988c-125219a0492f {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:18 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:18 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f 1073741824 Sep 08 14:05:18 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc220d0-d933-46d3-8f52-fa0d8cfc4b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea53ea96-8264-4998-b8f9-63d3f0613311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:18 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 (8b6c0d76-3bf4-4630-a857-4dc2145a20f0): created successfully Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea53ea96-8264-4998-b8f9-63d3f0613311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (c4d5f627-b1c5-49a6-aa31-e868f0e6704b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-24a466bb-83ad-4d62-a5ae-13a76555b00e tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created volume successfully. Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:18 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:18 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:19 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.455s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Deleted volume successfully. Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-394fcdfd-767e-45a6-b29a-0aa1a966944e tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-0073dfd3-1655-43a0-94f2-3083e8e1f19c-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:19 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f 1073741824" returned: 0 in 0.732s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:19 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f Sep 08 14:05:19 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-quobyte-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:19 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f" returned: 0 in 0.319s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317909558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64feb6f2-220f-48d7-bca3-aec5c63aa58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c365d1e9acb4d37869deb5aa05659b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:18Z,use_quota=True,user_id='0fa6bcb1c4c041d89ef45e2691c91e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Creating volume 64feb6f2-220f-48d7-bca3-aec5c63aa58a {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:19 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b7c79-bbd5-4390-86d9-004425d2d528]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:19 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a 1073741824 Sep 08 14:05:19 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696e6f7b-7f30-4286-9cc8-9ae837118e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084b9f48-84a2-4a78-988c-125219a0492f', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf387a0-b4d0-4eeb-9176-c28b7f53393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume volume-084b9f48-84a2-4a78-988c-125219a0492f (084b9f48-84a2-4a78-988c-125219a0492f): created successfully Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf387a0-b4d0-4eeb-9176-c28b7f53393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (733fc099-8bcf-44fc-8d12-73064bfb4107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-aa4b7a4e-4f24-4f0d-9598-3fbedcce4adb tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created volume successfully. Sep 08 14:05:19 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb Sep 08 14:05:19 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:20 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb" returned: 0 in 0.403s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:20 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb Sep 08 14:05:20 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:20 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a 1073741824" returned: 0 in 0.529s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:20 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a Sep 08 14:05:20 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:20 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb" returned: 0 in 0.275s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb" released by "delete_volume" :: held 0.743s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created reservations ['05ff8a42-1fc9-47f4-b97c-e69408af8fe0', 'aa28c25d-0f79-4db6-a474-1ae7979efbb8', 'df0e0266-24a9-4e61-9fc4-776aa63e2375', 'd189ccf6-6cce-4c33-b8d4-798204118797'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:20 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a" returned: 0 in 0.332s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd540ac-c914-4513-9cd0-8998d57c8a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061dc556-3b57-4c1b-a336-8b07b6e87f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Volume volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a (64feb6f2-220f-48d7-bca3-aec5c63aa58a): created successfully Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061dc556-3b57-4c1b-a336-8b07b6e87f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Flow 'volume_create_manager' (d229d6bb-4619-4b4d-af5c-c81e9b9126d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-73ad446e-d2b8-4795-a4e2-64cf3a0470df tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created volume successfully. Sep 08 14:05:20 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:20 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-e44e92f6-d602-4860-9939-2c4676bb4034-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-e44e92f6-d602-4860-9939-2c4676bb4034-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:20 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-quobyte-e44e92f6-d602-4860-9939-2c4676bb4034" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-e44e92f6-d602-4860-9939-2c4676bb4034" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8addb3fa-c6d1-4a90-a351-fea5841bf8e6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:21 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.361s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:21 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Deleted volume successfully. Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9e140f9c-fb02-4596-b16b-ae9f735e5c04 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-16346e5d-0b62-4a49-ad1b-9c7659cc6aeb-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:21 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 Sep 08 14:05:21 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-64feb6f2-220f-48d7-bca3-aec5c63aa58a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-64feb6f2-220f-48d7-bca3-aec5c63aa58a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-quobyte-64feb6f2-220f-48d7-bca3-aec5c63aa58a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-64feb6f2-220f-48d7-bca3-aec5c63aa58a" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0222af03-7afa-4479-8ae2-de471f6fcc94]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:21 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034" returned: 0 in 0.531s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:21 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034 Sep 08 14:05:21 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:21 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a Sep 08 14:05:21 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:21 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a" returned: 0 in 0.431s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:21 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-e44e92f6-d602-4860-9939-2c4676bb4034" returned: 0 in 0.361s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:21 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a Sep 08 14:05:21 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-e44e92f6-d602-4860-9939-2c4676bb4034" released by "delete_volume" :: held 0.954s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created reservations ['089cda75-8cf6-44e8-bedf-f3c304cda5e6', '1f5d6565-69d0-40c4-aef3-29e89a628495', '657d5735-e26f-44b7-9f26-7efc37b79f80', '100afdf6-015e-4d83-bf7e-f21fffeba49e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:22 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:22 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:22 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-64feb6f2-220f-48d7-bca3-aec5c63aa58a" returned: 0 in 0.317s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-64feb6f2-220f-48d7-bca3-aec5c63aa58a" released by "delete_volume" :: held 0.806s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created reservations ['0bd100c2-3bce-40ec-841e-e4c734d42e4e', 'a08b0e4a-1616-4100-8e13-2cf2221a51a0', '739a52b4-30b8-4f00-a408-767c545bc872', '5e3b96cc-f30b-47b1-8362-4b3f2933543d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:22 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.317s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Deleted volume successfully. Sep 08 14:05:22 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:22 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d27b3765-8012-43bf-9af6-f05c5968ce48 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-e44e92f6-d602-4860-9939-2c4676bb4034-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-084b9f48-84a2-4a78-988c-125219a0492f-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-084b9f48-84a2-4a78-988c-125219a0492f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-quobyte-084b9f48-84a2-4a78-988c-125219a0492f" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-084b9f48-84a2-4a78-988c-125219a0492f" acquired by "delete_volume" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[653a5519-d280-43f3-b83f-a998d6056047]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:22 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.394s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:22 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Deleted volume successfully. Sep 08 14:05:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-3e0e96d7-26bf-4eee-b3bd-988601384c66 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-64feb6f2-220f-48d7-bca3-aec5c63aa58a-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:22 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f Sep 08 14:05:22 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:23 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f" returned: 0 in 0.412s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:23 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f Sep 08 14:05:23 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-e267bc28-5561-477a-881f-4ef954143f2b-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-e267bc28-5561-477a-881f-4ef954143f2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-quobyte-2b52eea0-3c71-4355-b2ad-ff64efb98405" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-2b52eea0-3c71-4355-b2ad-ff64efb98405" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-quobyte-e267bc28-5561-477a-881f-4ef954143f2b" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-e267bc28-5561-477a-881f-4ef954143f2b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Deleting offline snapshot e267bc28-5561-477a-881f-4ef954143f2b of volume 2b52eea0-3c71-4355-b2ad-ff64efb98405 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] snapshot_file for this snap is: volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[349ca096-7a2b-49a0-85e4-773b7368cc73]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:23 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b Sep 08 14:05:23 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-084b9f48-84a2-4a78-988c-125219a0492f" returned: 0 in 0.355s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:23 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-084b9f48-84a2-4a78-988c-125219a0492f" released by "delete_volume" :: held 0.824s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created reservations ['2be04602-27ea-4baa-adb4-724620295245', '65b7e935-dcee-4054-a267-e6756a3ab08f', '94553376-1401-4044-a42f-537fc4a6ba3f', '45ce93d4-5a40-49e2-b9a9-a53e41a5d93c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:23 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:23 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-8b6c0d76-3bf4-4630-a857-4dc2145a20f0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:23 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (b87fcd98-fcdd-4ea6-b648-975110d8831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0560ca-6123-42da-97f7-3a1cb6e970f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b" returned: 0 in 0.593s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b52eea0-3c71-4355-b2ad-ff64efb98405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-8b6c0d76-3bf4-4630-a857-4dc2145a20f0-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5897f6-72d8-41b1-8853-800352048d2a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0560ca-6123-42da-97f7-3a1cb6e970f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302112358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53930a66-e348-439e-810f-81e8652097c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:24Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57db97ca-2034-408c-b73c-155d990596b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57db97ca-2034-408c-b73c-155d990596b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9b491c-5c41-4043-b2c8-132e66875c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9b491c-5c41-4043-b2c8-132e66875c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53930a66-e348-439e-810f-81e8652097c7', 'volume_name': 'volume-53930a66-e348-439e-810f-81e8652097c7', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab815a4-80ba-4202-9e05-5adda2627dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:24 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab815a4-80ba-4202-9e05-5adda2627dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9694c0-c010-40d2-a7fe-dc39441838be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Volume 53930a66-e348-439e-810f-81e8652097c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53930a66-e348-439e-810f-81e8652097c7', 'volume_size': 1} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302112358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53930a66-e348-439e-810f-81e8652097c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:24Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Creating volume 53930a66-e348-439e-810f-81e8652097c7 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:24 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.333s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:24 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 1073741824 Sep 08 14:05:24 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Deleted volume successfully. Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-quobyte-8b6c0d76-3bf4-4630-a857-4dc2145a20f0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:24 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 Sep 08 14:05:24 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-8b6c0d76-3bf4-4630-a857-4dc2145a20f0" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-82d8f899-7d9e-4416-89d0-d6a44e4facb7 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-084b9f48-84a2-4a78-988c-125219a0492f-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f73f75-13bd-4147-8b46-c8b0d77d32e8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:24 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 Sep 08 14:05:24 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:24 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405" returned: 0 in 0.508s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:24 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b Sep 08 14:05:24 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:24 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 1073741824" returned: 0 in 0.532s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:24 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:24 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0 Sep 08 14:05:24 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:24 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 Sep 08 14:05:24 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:24 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8b6c0d76-3bf4-4630-a857-4dc2145a20f0" returned: 0 in 0.273s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-8b6c0d76-3bf4-4630-a857-4dc2145a20f0" released by "delete_volume" :: held 0.752s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:24 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b" returned: 0 in 0.443s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:24 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7" returned: 0 in 0.305s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:24 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b Sep 08 14:05:24 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9694c0-c010-40d2-a7fe-dc39441838be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53930a66-e348-439e-810f-81e8652097c7', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b9dc09-a01f-4592-bb48-5b1e63a37d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Volume volume-53930a66-e348-439e-810f-81e8652097c7 (53930a66-e348-439e-810f-81e8652097c7): created successfully Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b9dc09-a01f-4592-bb48-5b1e63a37d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (b87fcd98-fcdd-4ea6-b648-975110d8831b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:24 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created reservations ['2977619d-81e5-4970-97d9-23dfc65be244', 'cd43394e-289a-4135-aa62-225cd2a9cf68', '7327018f-622a-4ad2-b452-b22f140e5c7f', '876ccdb7-6331-47e2-8ce8-a66c55aed7eb'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-da54219e-18b0-4f68-9ce5-7ae64b95c40c tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:25 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:25 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:25 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405.e267bc28-5561-477a-881f-4ef954143f2b" returned: 0 in 0.306s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-e267bc28-5561-477a-881f-4ef954143f2b" released by "_delete_snapshot" :: held 1.996s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-2b52eea0-3c71-4355-b2ad-ff64efb98405" released by "delete_snapshot" :: held 2.023s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Created reservations ['abc44211-7347-4d17-ab4c-ba65055c04e8', '2d244177-84b4-4e46-850f-054306b974d8', 'c9e68fb3-4f36-4303-8222-3b268c6ac0bf', '2c0fd4f3-0f04-4aa5-9cc9-bbe88a8fba0c'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:25 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.286s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Deleted volume successfully. Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7d95360a-85f1-4021-ab25-ad37a4111e77 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-8b6c0d76-3bf4-4630-a857-4dc2145a20f0-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Delete snapshot completed successfully. Sep 08 14:05:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-94ec22af-db43-4940-85af-4565317cf551 tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-e267bc28-5561-477a-881f-4ef954143f2b-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-38bee6a4-ee89-46c7-974f-ea15da28ae33-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-38bee6a4-ee89-46c7-974f-ea15da28ae33-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-quobyte-38bee6a4-ee89-46c7-974f-ea15da28ae33" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-38bee6a4-ee89-46c7-974f-ea15da28ae33" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e645c92b-31da-42f6-88ef-cb46a137554f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Creating offline snapshot b3ffbbbe-7c59-4459-9429-530f19a02233 of volume 53930a66-e348-439e-810f-81e8652097c7 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a68638-9a69-43f3-9eb0-20aae34257a8]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:26 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 Sep 08 14:05:26 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:26 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 Sep 08 14:05:26 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-2b52eea0-3c71-4355-b2ad-ff64efb98405-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-2b52eea0-3c71-4355-b2ad-ff64efb98405-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "cinder-quobyte-2b52eea0-3c71-4355-b2ad-ff64efb98405" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-2b52eea0-3c71-4355-b2ad-ff64efb98405" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e4513-19c0-4a5c-b9b0-24bfd9280f62]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:26 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33" returned: 0 in 0.412s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:26 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33 Sep 08 14:05:26 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:26 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7" returned: 0 in 0.411s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:26 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 1G Sep 08 14:05:26 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:26 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 Sep 08 14:05:26 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:26 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-38bee6a4-ee89-46c7-974f-ea15da28ae33" returned: 0 in 0.276s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-38bee6a4-ee89-46c7-974f-ea15da28ae33" released by "delete_volume" :: held 0.733s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:26 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created reservations ['1a11bbb7-f306-4049-a118-3a7a82460768', 'eed3e39f-bcb6-4161-8af6-c1e5424ce61d', '1c5fde31-edb6-4635-b3ce-1b87b94cfea3', '7e458012-8605-4746-bb24-1ab73d3b1a19'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:27 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405" returned: 0 in 0.448s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:27 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405 Sep 08 14:05:27 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:27 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:27 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:27 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 1G" returned: 0 in 0.502s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53930a66-e348-439e-810f-81e8652097c7 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:27 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53930a66-e348-439e-810f-81e8652097c7 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 Sep 08 14:05:27 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-583ed8f5-4884-4665-8155-e67768705030-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-583ed8f5-4884-4665-8155-e67768705030-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:27 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2b52eea0-3c71-4355-b2ad-ff64efb98405" returned: 0 in 0.396s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:27 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.346s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-quobyte-2b52eea0-3c71-4355-b2ad-ff64efb98405" released by "delete_volume" :: held 0.930s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Deleted volume successfully. Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-quobyte-583ed8f5-4884-4665-8155-e67768705030" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-db2ba1bb-0c2b-499b-9fa8-a2566fd2d8ec tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-38bee6a4-ee89-46c7-974f-ea15da28ae33-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-583ed8f5-4884-4665-8155-e67768705030" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a2e4c8-cab4-4dc2-b194-c8dd0a577aef]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:27 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53930a66-e348-439e-810f-81e8652097c7 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233" returned: 0 in 0.444s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:27 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 is being set with open permissions: ugo+rw Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Created reservations ['0b62e3eb-96ea-4119-b073-b4fcba3fc80e', '2dce4fab-ef57-46c3-9998-d7f7e3cfa234', '5aeb5681-9eef-46ed-b287-2dd0a779b575', '37247a5b-61cb-43a3-9a81-861e3b5e47ef'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:27 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 Sep 08 14:05:27 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:27 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 Sep 08 14:05:27 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:27 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:27 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:27 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233" returned: 0 in 0.341s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:28 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.info Sep 08 14:05:28 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:28 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.267s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Deleted volume successfully. Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-868c281e-cc4b-4c8f-983b-e35bbb6fdaba tempest-CreateVolumesFromSnapshotTest-28203450 None] Lock "cinder-2b52eea0-3c71-4355-b2ad-ff64efb98405-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:28 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030" returned: 0 in 0.534s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:28 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030 Sep 08 14:05:28 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:28 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.info" returned: 0 in 0.266s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:28 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.info is being set with open permissions: ugo+rw Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:28 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.info Sep 08 14:05:28 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:28 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-583ed8f5-4884-4665-8155-e67768705030" returned: 0 in 0.261s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-583ed8f5-4884-4665-8155-e67768705030" released by "delete_volume" :: held 0.858s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created reservations ['cf01991e-67de-4318-984c-6ed5719bc7a9', 'ea001304-7e2e-44e8-bd1c-8503dfe8a9e7', '126001d5-98a2-4c58-a50d-4a949e9dbece', '0ec6a324-c977-425c-90d3-5b706c0dc41f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:28 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:28 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:28 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.info" returned: 0 in 0.273s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-486722a7-d6b1-4145-bc9f-b6d7ba03125d-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-486722a7-d6b1-4145-bc9f-b6d7ba03125d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-561d73c7-0c53-47fc-b5f7-82bb01cda42f tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "cinder-quobyte-486722a7-d6b1-4145-bc9f-b6d7ba03125d" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-486722a7-d6b1-4145-bc9f-b6d7ba03125d" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[80965212-8e3e-455c-87e1-9fa435203185]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:28 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.306s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Deleted volume successfully. Sep 08 14:05:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-738ef712-4d16-49b7-862d-951075266f17 tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-583ed8f5-4884-4665-8155-e67768705030-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:28 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d Sep 08 14:05:28 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:29 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d" returned: 0 in 0.409s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:29 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d Sep 08 14:05:29 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:29 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-486722a7-d6b1-4145-bc9f-b6d7ba03125d" returned: 0 in 0.280s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-quobyte-486722a7-d6b1-4145-bc9f-b6d7ba03125d" released by "delete_volume" :: held 0.734s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-b3ffbbbe-7c59-4459-9429-530f19a02233-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Lock "cinder-b3ffbbbe-7c59-4459-9429-530f19a02233-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-53930a66-e348-439e-810f-81e8652097c7" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-53930a66-e348-439e-810f-81e8652097c7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-b3ffbbbe-7c59-4459-9429-530f19a02233" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-b3ffbbbe-7c59-4459-9429-530f19a02233" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot b3ffbbbe-7c59-4459-9429-530f19a02233 of volume 53930a66-e348-439e-810f-81e8652097c7 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Created reservations ['f9b80666-b15c-48ab-ab31-427e16bc1bbc', '8b0e4a16-afe6-4dd1-b6a9-476728c63ee2', 'c30c0e31-de85-43df-92d1-6e66b609d653', 'd90fa497-1b9f-4f64-8205-688f602d3871'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a720ddec-7d58-4fca-b062-6aa004c5df0d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:29 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:29 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:29 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 Sep 08 14:05:29 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:30 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.363s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:30 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Deleted volume successfully. Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-9aea5bb6-b24f-4f55-bd44-6e0d8d33e29b tempest-CreateVolumesFromSourceVolumeTest-106231587 None] Lock "cinder-486722a7-d6b1-4145-bc9f-b6d7ba03125d-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:30 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233" returned: 0 in 0.550s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53930a66-e348-439e-810f-81e8652097c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f6697c-2a9c-4a0f-9f6c-0d71447a21b1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:30 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 Sep 08 14:05:30 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:30 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7" returned: 0 in 0.427s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:30 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 Sep 08 14:05:30 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:31 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233" returned: 0 in 0.563s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:31 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233 Sep 08 14:05:31 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:31 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7.b3ffbbbe-7c59-4459-9429-530f19a02233" returned: 0 in 0.362s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-b3ffbbbe-7c59-4459-9429-530f19a02233" released by "_delete_snapshot" :: held 2.042s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-53930a66-e348-439e-810f-81e8652097c7" released by "delete_snapshot" :: held 2.081s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:31 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Created reservations ['18454d73-2ccb-4abf-9616-e034bcdf09f6', '50255f88-bf2a-4a55-824f-5b3878f204d1', 'e2e18fa6-95f0-45ce-a56a-5752934ed12b', 'ac070568-a776-42c1-8709-81ab8f9623aa'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:05:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c3daa2c6-ade6-4ad8-93f4-eb95ef5fdc3c tempest-ProjectMemberTests-837234304 None] Lock "cinder-b3ffbbbe-7c59-4459-9429-530f19a02233-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Flow 'volume_create_manager' (f9b046c4-d8f7-4047-beab-ab71069d7f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ece1184-5e90-48ae-9553-74d496cb993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ece1184-5e90-48ae-9553-74d496cb993b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6517650f-bb0d-4234-a444-f6b4b5c341cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5183c679a58478ca0f7fba6c88b5479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:32Z,use_quota=True,user_id='16bcf39869a44423b3f40073e2265838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ffe4a8-c945-42dd-b832-075963bb88c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ffe4a8-c945-42dd-b832-075963bb88c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a5a67b-9c84-48c6-89f1-f3f8198dd593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a5a67b-9c84-48c6-89f1-f3f8198dd593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6517650f-bb0d-4234-a444-f6b4b5c341cc', 'volume_name': 'volume-6517650f-bb0d-4234-a444-f6b4b5c341cc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077b431b-e216-41cb-8d67-9510abf62fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077b431b-e216-41cb-8d67-9510abf62fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d4ae68-8e40-4c57-8729-172f3caa0f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:32 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Volume 6517650f-bb0d-4234-a444-f6b4b5c341cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6517650f-bb0d-4234-a444-f6b4b5c341cc', 'volume_size': 1} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6517650f-bb0d-4234-a444-f6b4b5c341cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5183c679a58478ca0f7fba6c88b5479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:32Z,use_quota=True,user_id='16bcf39869a44423b3f40073e2265838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Creating volume 6517650f-bb0d-4234-a444-f6b4b5c341cc {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:32 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-53930a66-e348-439e-810f-81e8652097c7-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:32 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc 1073741824 Sep 08 14:05:32 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Lock "cinder-53930a66-e348-439e-810f-81e8652097c7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-53930a66-e348-439e-810f-81e8652097c7" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-53930a66-e348-439e-810f-81e8652097c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe519e1-bf0c-41bd-8a5d-890db59e0e21]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:33 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 Sep 08 14:05:33 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:33 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc 1073741824" returned: 0 in 0.583s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:33 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc Sep 08 14:05:33 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:33 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7" returned: 0 in 0.471s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:33 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7 Sep 08 14:05:33 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:33 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc" returned: 0 in 0.337s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d4ae68-8e40-4c57-8729-172f3caa0f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6517650f-bb0d-4234-a444-f6b4b5c341cc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5a49c4-6d43-45f7-93d3-0e71bf118eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:33 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Volume volume-6517650f-bb0d-4234-a444-f6b4b5c341cc (6517650f-bb0d-4234-a444-f6b4b5c341cc): created successfully Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5a49c4-6d43-45f7-93d3-0e71bf118eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Flow 'volume_create_manager' (f9b046c4-d8f7-4047-beab-ab71069d7f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:33 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-476449e5-829b-40f2-93f6-eca614cd42f2 tempest-CinderUnicodeTest-370474058 None] Created volume successfully. Sep 08 14:05:33 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-53930a66-e348-439e-810f-81e8652097c7" returned: 0 in 0.399s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-53930a66-e348-439e-810f-81e8652097c7" released by "delete_volume" :: held 0.965s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Created reservations ['67909fa7-19f1-4e6c-afa8-bde11a1c9541', '2ed7d435-bd98-4559-8c08-5850d90132f0', '9c01a838-eb6f-4752-afba-7696916ef708', '60fc1ec4-17fb-4e08-b310-c5606ace7a41'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:33 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:33 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:34 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.254s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:34 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:34 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:05:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cefa629f-26ae-407d-aaa2-311adf52ca4d tempest-ProjectMemberTests-837234304 None] Lock "cinder-53930a66-e348-439e-810f-81e8652097c7-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Flow 'volume_create_manager' (0a46cd59-0023-4f13-9a9a-3283e4fa623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bf7ee5-fb64-40cf-af01-97c636b29a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bf7ee5-fb64-40cf-af01-97c636b29a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-768767797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67108c1-a878-4dd8-b744-c95708bd14c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5183c679a58478ca0f7fba6c88b5479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:35Z,use_quota=True,user_id='16bcf39869a44423b3f40073e2265838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3cea1c-51b3-4332-8f7b-7cddf75bebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3cea1c-51b3-4332-8f7b-7cddf75bebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deadc9c5-e7d1-451c-89db-c47035b94906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deadc9c5-e7d1-451c-89db-c47035b94906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b67108c1-a878-4dd8-b744-c95708bd14c1', 'volume_name': 'volume-b67108c1-a878-4dd8-b744-c95708bd14c1', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df5003a-2e3f-4cf2-af0e-5c2aadcbb20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df5003a-2e3f-4cf2-af0e-5c2aadcbb20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1072e9-0f1f-4066-ae55-10c120470eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Volume b67108c1-a878-4dd8-b744-c95708bd14c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b67108c1-a878-4dd8-b744-c95708bd14c1', 'volume_size': 1} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-768767797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67108c1-a878-4dd8-b744-c95708bd14c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5183c679a58478ca0f7fba6c88b5479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:35Z,use_quota=True,user_id='16bcf39869a44423b3f40073e2265838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Creating volume b67108c1-a878-4dd8-b744-c95708bd14c1 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:35 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:35 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 1073741824 Sep 08 14:05:35 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (6432fb27-bbfc-4f29-819f-9119b1b156e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f877fa96-cb63-4a4e-88a3-1f201328347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f877fa96-cb63-4a4e-88a3-1f201328347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109838545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1baf30c1-0712-4dad-84a9-c60027ee62b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:36Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa73719-492e-4c2a-91c0-35feb4f46e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa73719-492e-4c2a-91c0-35feb4f46e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5888eb-6742-49b9-9954-64258e7e599a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5888eb-6742-49b9-9954-64258e7e599a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1baf30c1-0712-4dad-84a9-c60027ee62b2', 'volume_name': 'volume-1baf30c1-0712-4dad-84a9-c60027ee62b2', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96acb22-b747-42e1-8571-bb93ac0bfa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96acb22-b747-42e1-8571-bb93ac0bfa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3455a0-4b73-472c-b0f2-b78b7c0d506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:35 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Volume 1baf30c1-0712-4dad-84a9-c60027ee62b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1baf30c1-0712-4dad-84a9-c60027ee62b2', 'volume_size': 1} Sep 08 14:05:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:36 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 1073741824" returned: 0 in 0.588s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:36 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 Sep 08 14:05:36 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:36 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1" returned: 0 in 0.304s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109838545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1baf30c1-0712-4dad-84a9-c60027ee62b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:36Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Creating volume 1baf30c1-0712-4dad-84a9-c60027ee62b2 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:36 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:36 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 1073741824 Sep 08 14:05:36 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1072e9-0f1f-4066-ae55-10c120470eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67108c1-a878-4dd8-b744-c95708bd14c1', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a88682a-85b8-4606-9809-5826bf034c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Volume volume-b67108c1-a878-4dd8-b744-c95708bd14c1 (b67108c1-a878-4dd8-b744-c95708bd14c1): created successfully Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a88682a-85b8-4606-9809-5826bf034c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Flow 'volume_create_manager' (0a46cd59-0023-4f13-9a9a-3283e4fa623c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0a26deec-3aa5-406d-ac9b-dfa175f3ee0b tempest-CinderUnicodeTest-370474058 None] Created volume successfully. Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Flow 'volume_create_manager' (c535ef5e-84c9-4b13-97d7-48ca029aecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb79238-6676-4856-8203-87bc8fae71d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb79238-6676-4856-8203-87bc8fae71d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a26b842-a880-412a-849d-3e3c75d3a14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa09f326fb64d02beae2db85d4e176e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:37Z,use_quota=True,user_id='6ad96ada8834423190a6564f59ca8579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b4e255-85f7-467f-a714-f73bda6af7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b4e255-85f7-467f-a714-f73bda6af7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000a34b4-a63f-4a2b-8c9b-398e7b848e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.image.glance [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Creating Keystone auth plugin from conf {{(pid=87262) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Flow 'volume_create_manager' (6020eaff-8135-4295-bcd5-54debe8ecd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296a3166-1015-495b-b4e7-ad11a9820491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296a3166-1015-495b-b4e7-ad11a9820491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197330645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d71082-ddae-4bbf-8b64-4d60fe0fe6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f2bf34d5364128b7aa0549ed33e357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:37Z,use_quota=True,user_id='c5bbf21390ef41888729743b3f18165f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e60ecc-1925-4fc3-a2d4-e1bcced365f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e60ecc-1925-4fc3-a2d4-e1bcced365f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff141f6-2124-400e-beb1-0317569418dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff141f6-2124-400e-beb1-0317569418dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d71082-ddae-4bbf-8b64-4d60fe0fe6bc', 'volume_name': 'volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe91dca-6e6f-4472-8a21-3cee94bafcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe91dca-6e6f-4472-8a21-3cee94bafcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f5d64f-ec97-40f9-a114-a4e9c155c596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:36 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Volume 67d71082-ddae-4bbf-8b64-4d60fe0fe6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc', 'volume_size': 1} Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:36 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 1073741824" returned: 0 in 0.470s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:37 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 Sep 08 14:05:37 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000a34b4-a63f-4a2b-8c9b-398e7b848e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a26b842-a880-412a-849d-3e3c75d3a14b', 'volume_name': 'volume-2a26b842-a880-412a-849d-3e3c75d3a14b', 'volume_size': 1, 'image_id': 'd53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71ece1280c30807869b318ece35821fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2aa09f326fb64d02beae2db85d4e176e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a012fc09990941503b2164b9ce5f4bc62d581368cf44a0fce6736fb2bf7b9b060df70a086ffb4fd305088aef828577ebcbd01496624791b64ff8e8df6e0239d0', 'id': 'd53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'created_at': datetime.datetime(2026, 9, 8, 12, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 12, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033/file', 'properties': {}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2a43c3-7ab6-4aeb-b816-a1df6b1461eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2a43c3-7ab6-4aeb-b816-a1df6b1461eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ac1991-04cd-4c9a-80a7-ba43af5d3253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:37 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Volume 2a26b842-a880-412a-849d-3e3c75d3a14b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a26b842-a880-412a-849d-3e3c75d3a14b', 'volume_size': 1, 'image_id': 'd53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71ece1280c30807869b318ece35821fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2aa09f326fb64d02beae2db85d4e176e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a012fc09990941503b2164b9ce5f4bc62d581368cf44a0fce6736fb2bf7b9b060df70a086ffb4fd305088aef828577ebcbd01496624791b64ff8e8df6e0239d0', 'id': 'd53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'created_at': datetime.datetime(2026, 9, 8, 12, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 12, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033/file', 'properties': {}}, 'image_service': } Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Trying to clone 2a26b842-a880-412a-849d-3e3c75d3a14b from image d53d8e14-05d0-4b07-a5b1-6c1c5da44033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'metadata': {}}]). {{(pid=87262) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 14:05:37 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2" returned: 0 in 0.257s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197330645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d71082-ddae-4bbf-8b64-4d60fe0fe6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f2bf34d5364128b7aa0549ed33e357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:37Z,use_quota=True,user_id='c5bbf21390ef41888729743b3f18165f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Creating volume 67d71082-ddae-4bbf-8b64-4d60fe0fe6bc {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:37 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 14:05:37 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Image download 0.00 MB at 0.00 MB/s Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3455a0-4b73-472c-b0f2-b78b7c0d506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1baf30c1-0712-4dad-84a9-c60027ee62b2', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:37 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc 1073741824 Sep 08 14:05:37 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00da2a5-ae18-440b-9052-9eca74c144f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:37 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Volume volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 (1baf30c1-0712-4dad-84a9-c60027ee62b2): created successfully Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00da2a5-ae18-440b-9052-9eca74c144f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (6432fb27-bbfc-4f29-819f-9119b1b156e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:37 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c06a334e-5eed-4b89-96c1-f94dbb4eff65 tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0798beec-bc98-4776-b427-eda92e635101]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:37 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD Sep 08 14:05:37 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:37 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:37 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc 1073741824" returned: 0 in 0.524s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:37 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc Sep 08 14:05:37 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:37 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD Sep 08 14:05:37 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:38 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc" returned: 0 in 0.277s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.384s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f5d64f-ec97-40f9-a114-a4e9c155c596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46336e1b-9062-4bc4-a4bb-97f37f055a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:38 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Creating offline snapshot f7d97291-b4e4-4e60-b7c0-a8b1446d264b of volume b67108c1-a878-4dd8-b744-c95708bd14c1 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:05:38 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Volume volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc (67d71082-ddae-4bbf-8b64-4d60fe0fe6bc): created successfully Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46336e1b-9062-4bc4-a4bb-97f37f055a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Flow 'volume_create_manager' (6020eaff-8135-4295-bcd5-54debe8ecd90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8320c192-1c8c-44fd-9df7-42d8c0b591f0]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Temporary image d53d8e14-05d0-4b07-a5b1-6c1c5da44033 is fetched for user 6ad96ada8834423190a6564f59ca8579. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 14:05:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fb86e645-049d-4bbd-b509-7b2851b5116a tempest-ProjectReaderTests-449982536 None] Created volume successfully. Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c493059d-6b5b-44a3-a683-d59fffb3aaad]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:38 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 Sep 08 14:05:38 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:38 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD Sep 08 14:05:38 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:38 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1" returned: 0 in 0.403s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:38 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:38 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b 1G Sep 08 14:05:38 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Acquiring lock "cinder-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:38 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Lock "cinder-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:38 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Acquiring lock "cinder-quobyte-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Lock "cinder-quobyte-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d48ee7-ce1b-4317-8017-a332c52cbc95]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:38 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc Sep 08 14:05:38 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:38 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:05:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:39 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b 1G" returned: 0 in 0.420s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b67108c1-a878-4dd8-b744-c95708bd14c1 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:39 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b67108c1-a878-4dd8-b744-c95708bd14c1 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b Sep 08 14:05:39 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:39 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc" returned: 0 in 0.423s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:39 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc Sep 08 14:05:39 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:39 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b67108c1-a878-4dd8-b744-c95708bd14c1 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b" returned: 0 in 0.348s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:39 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b is being set with open permissions: ugo+rw Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:39 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b Sep 08 14:05:39 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:39 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Lock "cinder-quobyte-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc" released by "delete_volume" :: held 0.758s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:39 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Created reservations ['fdc22878-2a77-4dd8-a2d6-1b6689d90d31', '1ec6aa1e-228c-4bb9-a7b9-ce0658bab648', '555ccdf5-bdd5-480a-b6b9-e38028b9bf01', '50f45141-505b-41a3-8038-054ae4b45f03'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b" returned: 0 in 0.286s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:39 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.info Sep 08 14:05:39 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:39 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:39 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:39 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.info" returned: 0 in 0.298s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:39 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.info is being set with open permissions: ugo+rw Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:40 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.258s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Deleted volume successfully. Sep 08 14:05:40 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.info Sep 08 14:05:40 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-92e5a8b0-7c8a-4f7f-96a4-c301a97d65e5 tempest-ProjectReaderTests-449982536 None] Lock "cinder-67d71082-ddae-4bbf-8b64-4d60fe0fe6bc-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:40 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.info" returned: 0 in 0.287s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.276s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Creating offline snapshot dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e of volume 1baf30c1-0712-4dad-84a9-c60027ee62b2 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:05:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-48a92ad9-169a-4bdf-9ad5-8cdbb569f23e tempest-CinderUnicodeTest-370474058 None] Create snapshot completed successfully Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedc3f78-f09d-494e-b4cb-6cc173085427]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Flow 'volume_create_manager' (9c577c34-899a-46e3-afff-79fbd3b63e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a452ee-dd33-4d93-8d91-559476228e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a452ee-dd33-4d93-8d91-559476228e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403384181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9e94db-0fa3-41b3-a6aa-4a149237a7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f2bf34d5364128b7aa0549ed33e357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:40Z,use_quota=True,user_id='c5bbf21390ef41888729743b3f18165f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4ed4c1-c0d4-45d2-8715-473ce010c1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4ed4c1-c0d4-45d2-8715-473ce010c1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e94a781-5043-4ba6-a826-95ffa3c0f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:40 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 Sep 08 14:05:40 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e94a781-5043-4ba6-a826-95ffa3c0f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9e94db-0fa3-41b3-a6aa-4a149237a7e7', 'volume_name': 'volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f58320d-1511-4657-9c33-1f883d750e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f58320d-1511-4657-9c33-1f883d750e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602c9725-62c5-4f2e-b3b8-c69a1fd2e973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:40 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Volume 9f9e94db-0fa3-41b3-a6aa-4a149237a7e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7', 'volume_size': 1} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:40 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2" returned: 0 in 0.367s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:40 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e 1G Sep 08 14:05:40 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Acquiring lock "cinder-f7d97291-b4e4-4e60-b7c0-a8b1446d264b-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Lock "cinder-f7d97291-b4e4-4e60-b7c0-a8b1446d264b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Acquiring lock "cinder-quobyte-b67108c1-a878-4dd8-b744-c95708bd14c1" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Lock "cinder-quobyte-b67108c1-a878-4dd8-b744-c95708bd14c1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Acquiring lock "cinder-quobyte-f7d97291-b4e4-4e60-b7c0-a8b1446d264b" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Lock "cinder-quobyte-f7d97291-b4e4-4e60-b7c0-a8b1446d264b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Deleting offline snapshot f7d97291-b4e4-4e60-b7c0-a8b1446d264b of volume b67108c1-a878-4dd8-b744-c95708bd14c1 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] snapshot_file for this snap is: volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[da62e5e9-16fc-47ce-adb8-fe4721c5df19]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:41 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b Sep 08 14:05:41 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:41 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e 1G" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:41 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e Sep 08 14:05:41 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:41 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b" returned: 0 in 0.359s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b67108c1-a878-4dd8-b744-c95708bd14c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f11df7-5bf9-404e-93d6-77a72d50b132]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:41 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e" returned: 0 in 0.325s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:41 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e is being set with open permissions: ugo+rw Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:41 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e Sep 08 14:05:41 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:41 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 Sep 08 14:05:41 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:41 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e" returned: 0 in 0.248s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:41 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.info Sep 08 14:05:41 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:41 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1" returned: 0 in 0.365s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:41 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b Sep 08 14:05:41 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:41 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.info" returned: 0 in 0.252s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:41 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.info is being set with open permissions: ugo+rw Sep 08 14:05:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:42 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.info Sep 08 14:05:42 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:42 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b" returned: 0 in 0.359s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:42 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b Sep 08 14:05:42 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:42 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.info" returned: 0 in 0.253s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.298s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a26b842-a880-412a-849d-3e3c75d3a14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa09f326fb64d02beae2db85d4e176e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:37Z,use_quota=True,user_id='6ad96ada8834423190a6564f59ca8579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Creating volume 2a26b842-a880-412a-849d-3e3c75d3a14b {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:42 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:42 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b 1073741824 Sep 08 14:05:42 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d5deddc7-05e7-40dd-8e21-fac2efc32734 tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:05:42 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1.f7d97291-b4e4-4e60-b7c0-a8b1446d264b" returned: 0 in 0.286s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Lock "cinder-quobyte-f7d97291-b4e4-4e60-b7c0-a8b1446d264b" released by "_delete_snapshot" :: held 1.464s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Lock "cinder-quobyte-b67108c1-a878-4dd8-b744-c95708bd14c1" released by "delete_snapshot" :: held 1.488s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Created reservations ['f75cad6d-308b-4f87-ad2f-9c71b3f8e2db', '26fd446b-70eb-4b8e-a616-1d4278a88a5c', 'a43aa0b7-bbe1-42ce-922a-4909d5adc420', '44deace7-e2c5-49ff-9b0f-1f0f2033f527'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Delete snapshot completed successfully. Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-40b8c064-ada3-459d-a9ed-f7a08fc5c63f tempest-CinderUnicodeTest-370474058 None] Lock "cinder-f7d97291-b4e4-4e60-b7c0-a8b1446d264b-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:42 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b 1073741824" returned: 0 in 0.478s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:42 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b Sep 08 14:05:42 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:43 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b" returned: 0 in 0.241s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.566s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403384181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9e94db-0fa3-41b3-a6aa-4a149237a7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f2bf34d5364128b7aa0549ed33e357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:40Z,use_quota=True,user_id='c5bbf21390ef41888729743b3f18165f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Creating volume 9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:43 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:43 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 1073741824 Sep 08 14:05:43 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Attempting download of d53d8e14-05d0-4b07-a5b1-6c1c5da44033 ((None, [{'url': 'file:///opt/stack/data/glance/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'metadata': {}}])) to volume 2a26b842-a880-412a-849d-3e3c75d3a14b. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Acquiring lock "cinder-b67108c1-a878-4dd8-b744-c95708bd14c1-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Lock "cinder-b67108c1-a878-4dd8-b744-c95708bd14c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eb6af9-92aa-4f92-978b-80c81cc7431c]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_vp5sqzh2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Acquiring lock "cinder-quobyte-b67108c1-a878-4dd8-b744-c95708bd14c1" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Lock "cinder-quobyte-b67108c1-a878-4dd8-b744-c95708bd14c1" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0901274d-44b6-4235-ab09-744c8fc9dce6]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:43 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_vp5sqzh2 Sep 08 14:05:43 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Lock "cinder-dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-1baf30c1-0712-4dad-84a9-c60027ee62b2" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-1baf30c1-0712-4dad-84a9-c60027ee62b2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e of volume 1baf30c1-0712-4dad-84a9-c60027ee62b2 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8eb348-281e-44aa-b014-cfa19fe82808]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:43 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 Sep 08 14:05:43 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:43 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_vp5sqzh2" returned: 0 in 0.379s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_vp5sqzh2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:43 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e Sep 08 14:05:43 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:43 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 1073741824" returned: 0 in 0.559s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:43 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 Sep 08 14:05:43 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:43 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_vp5sqzh2 Sep 08 14:05:43 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:43 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1" returned: 0 in 0.492s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:43 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1 Sep 08 14:05:43 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:43 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e" returned: 0 in 0.490s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1baf30c1-0712-4dad-84a9-c60027ee62b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:05:43 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:43 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_vp5sqzh2" returned: 1 in 0.383s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_vp5sqzh2' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7" returned: 0 in 0.309s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d952de-f557-4105-b7e2-d98d134d00dc]: (4, 'raw') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[46647692-b00f-4de9-adef-fdd8ddef316a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602c9725-62c5-4f2e-b3b8-c69a1fd2e973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad5076-5c78-4a85-b795-9d74d87fa231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:44 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Volume volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 (9f9e94db-0fa3-41b3-a6aa-4a149237a7e7): created successfully Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad5076-5c78-4a85-b795-9d74d87fa231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Flow 'volume_create_manager' (9c577c34-899a-46e3-afff-79fbd3b63e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-dcd47696-efa5-41ba-b32a-ee49dc7f4d78 tempest-ProjectReaderTests-449982536 None] Created volume successfully. Sep 08 14:05:44 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD Sep 08 14:05:44 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:44 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 Sep 08 14:05:44 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:44 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b67108c1-a878-4dd8-b744-c95708bd14c1" returned: 0 in 0.320s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Lock "cinder-quobyte-b67108c1-a878-4dd8-b744-c95708bd14c1" released by "delete_volume" :: held 0.905s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Created reservations ['04bc1d77-6ff1-4265-8f32-0e3a4d8c1d92', 'bd8383cb-78c1-48e9-a1f3-49c2512aa48b', '0ba2bfb1-7fda-42c3-8bd8-c6b7d48e244e', 'a299d219-2ce4-4da1-adff-de6cf0ed3300'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:44 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:44 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:44 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:44 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2" returned: 0 in 0.432s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:44 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD Sep 08 14:05:44 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:44 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e Sep 08 14:05:44 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:44 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.263s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Deleted volume successfully. Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-feb13cfc-9773-4df6-b4af-47e0e3de9c6b tempest-CinderUnicodeTest-370474058 None] Lock "cinder-b67108c1-a878-4dd8-b744-c95708bd14c1-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:44 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Acquiring lock "cinder-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] d53d8e14-05d0-4b07-a5b1-6c1c5da44033 was raw, converting to qcow2 {{(pid=87262) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Lock "cinder-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:44 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b Sep 08 14:05:44 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Acquiring lock "cinder-quobyte-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Lock "cinder-quobyte-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:44 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e" returned: 0 in 0.409s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9d6af9-13e9-42f8-8217-175ba8309fdc]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:44 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e Sep 08 14:05:44 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:44 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 Sep 08 14:05:44 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:45 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2.dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e" returned: 0 in 0.288s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e" released by "_delete_snapshot" :: held 1.748s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-1baf30c1-0712-4dad-84a9-c60027ee62b2" released by "delete_snapshot" :: held 1.773s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:45 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7" returned: 0 in 0.387s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:45 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Created reservations ['46b5a0bc-0e8f-4c0e-aade-a4b7e3a671b8', 'c2e9dfd1-ee4f-4e23-b059-3113129835ca', 'a9bfee22-aeed-4d25-b22f-6544da0b29fd', '4d4dd27e-5ae6-410d-b239-0d30056df71a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b" returned: 0 in 0.531s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d53d8e14-05d0-4b07-a5b1-6c1c5da44033_di049q4mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:05:45 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:45 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7 Sep 08 14:05:45 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:45 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b 1G Sep 08 14:05:45 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb79d6d7-bb92-42b8-845d-eaa43a391d1b tempest-ProjectMemberTests-837234304 None] Lock "cinder-dbc2accd-35d6-4fda-b9d7-1ab4ba7e917e-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Acquiring lock "cinder-6517650f-bb0d-4234-a444-f6b4b5c341cc-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Lock "cinder-6517650f-bb0d-4234-a444-f6b4b5c341cc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Acquiring lock "cinder-quobyte-6517650f-bb0d-4234-a444-f6b4b5c341cc" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-1baf30c1-0712-4dad-84a9-c60027ee62b2-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Lock "cinder-quobyte-6517650f-bb0d-4234-a444-f6b4b5c341cc" acquired by "delete_volume" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d276a4cb-37b8-4096-97bf-9c2f5de6815f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Lock "cinder-1baf30c1-0712-4dad-84a9-c60027ee62b2-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:45 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7" returned: 0 in 0.413s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:45 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Lock "cinder-quobyte-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7" released by "delete_volume" :: held 0.851s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b 1G" returned: 0 in 0.416s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Downloaded image d53d8e14-05d0-4b07-a5b1-6c1c5da44033 ((None, [{'url': 'file:///opt/stack/data/glance/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'metadata': {}}])) to volume 2a26b842-a880-412a-849d-3e3c75d3a14b successfully. {{(pid=87262) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Temporary image d53d8e14-05d0-4b07-a5b1-6c1c5da44033 for user 6ad96ada8834423190a6564f59ca8579 is deleted. {{(pid=87262) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.volume_utils [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Marking volume 2a26b842-a880-412a-849d-3e3c75d3a14b as bootable. {{(pid=87262) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-1baf30c1-0712-4dad-84a9-c60027ee62b2" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Copying metadata from image d53d8e14-05d0-4b07-a5b1-6c1c5da44033 to 2a26b842-a880-412a-849d-3e3c75d3a14b. {{(pid=87262) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Creating volume glance metadata for volume 2a26b842-a880-412a-849d-3e3c75d3a14b backed by image d53d8e14-05d0-4b07-a5b1-6c1c5da44033 with: {'image_id': 'd53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '71ece1280c30807869b318ece35821fe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87262) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-1baf30c1-0712-4dad-84a9-c60027ee62b2" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:45 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc Sep 08 14:05:45 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6dc19c-d7ae-4441-8945-63e8cfeed224]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Created reservations ['42bcfec7-f2a8-4ca2-a142-3b378624c56e', 'c11cc97f-d7f8-4f1e-b2f9-19ca34c36623', '7561f109-bbae-4536-b0ae-4739ad3bf77a', '9c5c19cc-45fa-4e46-89d8-cfcd07abaeed'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ac1991-04cd-4c9a-80a7-ba43af5d3253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a26b842-a880-412a-849d-3e3c75d3a14b', 'volume_size': 1, 'image_id': 'd53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71ece1280c30807869b318ece35821fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2aa09f326fb64d02beae2db85d4e176e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a012fc09990941503b2164b9ce5f4bc62d581368cf44a0fce6736fb2bf7b9b060df70a086ffb4fd305088aef828577ebcbd01496624791b64ff8e8df6e0239d0', 'id': 'd53d8e14-05d0-4b07-a5b1-6c1c5da44033', 'created_at': datetime.datetime(2026, 9, 8, 12, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 12, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d53d8e14-05d0-4b07-a5b1-6c1c5da44033/file', 'properties': {}}, 'image_service': }' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055ce9e1-e3a6-4ba8-955e-d3fd05547c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:45 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Volume volume-2a26b842-a880-412a-849d-3e3c75d3a14b (2a26b842-a880-412a-849d-3e3c75d3a14b): created successfully Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055ce9e1-e3a6-4ba8-955e-d3fd05547c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Flow 'volume_create_manager' (c535ef5e-84c9-4b13-97d7-48ca029aecaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:45 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 Sep 08 14:05:45 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1b4a2d01-7b13-4e98-bbc6-5ef5a87135ee tempest-VolumeImageDependencyTests-888189639 None] Created volume successfully. Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:45 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:45 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:46 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc" returned: 0 in 0.484s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:46 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc Sep 08 14:05:46 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:46 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2" returned: 0 in 0.460s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:46 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.294s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:46 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2 Sep 08 14:05:46 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:46 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Deleted volume successfully. Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-23b05aed-475c-4790-a87e-1be7dab683c3 tempest-ProjectReaderTests-449982536 None] Lock "cinder-9f9e94db-0fa3-41b3-a6aa-4a149237a7e7-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:46 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-6517650f-bb0d-4234-a444-f6b4b5c341cc" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Lock "cinder-quobyte-6517650f-bb0d-4234-a444-f6b4b5c341cc" released by "delete_volume" :: held 0.825s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Created reservations ['0f25cc31-4e6e-42eb-b8cf-9777b35fd23f', '2a965f31-b2b3-4934-8887-f362ad5b9b38', '56af2a9d-d0c0-4909-b24a-7c7f4cdd05d3', '13544365-f422-4856-95a1-9052cd6b08a2'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:46 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-1baf30c1-0712-4dad-84a9-c60027ee62b2" returned: 0 in 0.279s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:46 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:46 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-1baf30c1-0712-4dad-84a9-c60027ee62b2" released by "delete_volume" :: held 0.814s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Created reservations ['3840fb4f-3383-4123-98ab-954e61a59f5b', '8566ddea-4125-4a1f-ab02-16ee2fd7b9b8', 'd632a365-c74e-406d-ae31-c57e4e17f52a', 'de1fadaf-58e2-445f-aa57-54d6a5f18330'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:46 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:46 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:46 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.299s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:46 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Deleted volume successfully. Sep 08 14:05:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-cbe0d4ae-be80-4591-8253-5e363ae309bf tempest-CinderUnicodeTest-370474058 None] Lock "cinder-6517650f-bb0d-4234-a444-f6b4b5c341cc-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:47 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.352s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:47 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-167e8919-4522-4119-ba56-7568d01ee902 tempest-ProjectMemberTests-837234304 None] Lock "cinder-1baf30c1-0712-4dad-84a9-c60027ee62b2-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Acquiring lock "cinder-2a26b842-a880-412a-849d-3e3c75d3a14b-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Lock "cinder-2a26b842-a880-412a-849d-3e3c75d3a14b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Acquiring lock "cinder-quobyte-2a26b842-a880-412a-849d-3e3c75d3a14b" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Lock "cinder-quobyte-2a26b842-a880-412a-849d-3e3c75d3a14b" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[696a897f-65f2-4040-a8b9-c1626691e877]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (c7db98b8-3863-4ba6-961c-5599c4d3c313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bc427b-2585-4add-a757-2e892b65c078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bc427b-2585-4add-a757-2e892b65c078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-811486681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafa109b-8cc0-4530-8ef7-02b6480d92a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:47Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de3f076-4177-42b9-affc-08d245bd7ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de3f076-4177-42b9-affc-08d245bd7ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682eb5d2-da0b-4a51-90d2-6d0d60902c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682eb5d2-da0b-4a51-90d2-6d0d60902c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafa109b-8cc0-4530-8ef7-02b6480d92a6', 'volume_name': 'volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:47 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b Sep 08 14:05:47 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b249b52-ca07-4332-8331-e7e4e236e8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b249b52-ca07-4332-8331-e7e4e236e8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6983ff76-61c2-4101-9411-f839e74a8294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:47 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Volume dafa109b-8cc0-4530-8ef7-02b6480d92a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6', 'volume_size': 1} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-811486681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafa109b-8cc0-4530-8ef7-02b6480d92a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:47Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Creating volume dafa109b-8cc0-4530-8ef7-02b6480d92a6 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:47 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:47 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 1073741824 Sep 08 14:05:47 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:47 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b" returned: 0 in 0.491s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:47 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b Sep 08 14:05:47 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:48 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 1073741824" returned: 0 in 0.540s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:48 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-2a26b842-a880-412a-849d-3e3c75d3a14b" returned: 0 in 0.273s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Lock "cinder-quobyte-2a26b842-a880-412a-849d-3e3c75d3a14b" released by "delete_volume" :: held 0.840s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:48 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 Sep 08 14:05:48 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Created reservations ['6ad7f739-5137-4565-b9b4-7423c2a99129', '3358a840-68c4-438a-8195-4725ec5fd405', '8f366314-d92c-4abe-9ec8-ed6774bd859d', 'e549d64c-97b8-4121-a9a6-66e5e0c63c6f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:48 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:48 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:48 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6" returned: 0 in 0.497s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6983ff76-61c2-4101-9411-f839e74a8294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7466ee88-cd2a-4d02-9841-d63a2ab9d129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:48 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Volume volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 (dafa109b-8cc0-4530-8ef7-02b6480d92a6): created successfully Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7466ee88-cd2a-4d02-9841-d63a2ab9d129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (c7db98b8-3863-4ba6-961c-5599c4d3c313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=340,cinder:SELECT=244,cinder:INSERT=91,cinder:DELETE=30 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:05:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-81f56732-7396-4f99-9456-4c4831c7f65d tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=253,cinder:UPDATE=337,cinder:INSERT=89,cinder:DELETE=29 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:05:48 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.510s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Deleted volume successfully. Sep 08 14:05:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-01a01c9f-3c08-4e59-b155-8c0f26f5c0fd tempest-VolumeImageDependencyTests-888189639 None] Lock "cinder-2a26b842-a880-412a-849d-3e3c75d3a14b-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Creating offline snapshot b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 of volume dafa109b-8cc0-4530-8ef7-02b6480d92a6 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:05:49 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9ce7e8-221b-408e-8b04-49e5694d2e44]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:49 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 Sep 08 14:05:49 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:50 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6" returned: 0 in 0.445s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:50 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 1G Sep 08 14:05:50 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:50 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 1G" returned: 0 in 0.527s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:50 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 Sep 08 14:05:50 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:51 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6" returned: 0 in 0.293s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:51 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 is being set with open permissions: ugo+rw Sep 08 14:05:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:51 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 Sep 08 14:05:51 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:51 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:51 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.info Sep 08 14:05:51 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:51 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.info" returned: 0 in 0.261s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:51 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.info is being set with open permissions: ugo+rw Sep 08 14:05:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:51 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.info Sep 08 14:05:51 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:51 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.info" returned: 0 in 0.241s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-579c3687-f34f-4670-9ca7-7985e0f739ea tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:05:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-b0eb96f2-c91d-4fba-81b1-bc998c1df2c6-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-b0eb96f2-c91d-4fba-81b1-bc998c1df2c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-dafa109b-8cc0-4530-8ef7-02b6480d92a6" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-dafa109b-8cc0-4530-8ef7-02b6480d92a6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-b0eb96f2-c91d-4fba-81b1-bc998c1df2c6" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-b0eb96f2-c91d-4fba-81b1-bc998c1df2c6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 of volume dafa109b-8cc0-4530-8ef7-02b6480d92a6 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[924c7b9f-727f-4a8d-9a80-524ce0ae9b5f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:53 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 Sep 08 14:05:53 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:53 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6" returned: 0 in 0.451s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb7d230-1eb4-45a1-889c-6e58b63eeb77]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:53 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 Sep 08 14:05:53 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:53 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6" returned: 0 in 0.449s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:54 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 Sep 08 14:05:54 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:54 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6" returned: 0 in 0.565s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:54 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6 Sep 08 14:05:54 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:54 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6.b0eb96f2-c91d-4fba-81b1-bc998c1df2c6" returned: 0 in 0.359s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-b0eb96f2-c91d-4fba-81b1-bc998c1df2c6" released by "_delete_snapshot" :: held 1.984s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-dafa109b-8cc0-4530-8ef7-02b6480d92a6" released by "delete_snapshot" :: held 2.011s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:55 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Created reservations ['67b68c2b-602b-40c2-9de1-2b7d892ea3ec', 'e11c2728-50de-4e74-8c82-f4b27daf4198', '744df728-380a-495d-9135-065953417806', '0a850bed-e3b6-4574-871c-b67eda001dc2'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:55 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:05:55 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-260136be-f96b-4aa6-aac6-48b1725fcfd1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-b0eb96f2-c91d-4fba-81b1-bc998c1df2c6-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-dafa109b-8cc0-4530-8ef7-02b6480d92a6-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-dafa109b-8cc0-4530-8ef7-02b6480d92a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-dafa109b-8cc0-4530-8ef7-02b6480d92a6" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:05:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-dafa109b-8cc0-4530-8ef7-02b6480d92a6" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:05:56 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6557beb-df35-4d82-86c7-86ad35cb701f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:05:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:56 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 Sep 08 14:05:56 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:56 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6" returned: 0 in 0.397s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:56 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6 Sep 08 14:05:56 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:57 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-dafa109b-8cc0-4530-8ef7-02b6480d92a6" returned: 0 in 0.360s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-dafa109b-8cc0-4530-8ef7-02b6480d92a6" released by "delete_volume" :: held 0.855s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Created reservations ['d25b18b8-a66c-4a27-b480-c2b173a1f4d2', '145927dd-d74d-4aa8-a7da-fa9c69a3f714', '8ba94e47-f3b3-4213-84f8-fc51c144a7f0', '62a55018-7e8c-4641-a837-eff815765891'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:57 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:05:57 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:57 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.381s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:05:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:05:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7b7b4109-e21f-430f-a340-54d9439db3b1 tempest-ProjectMemberTests-837234304 None] Lock "cinder-dafa109b-8cc0-4530-8ef7-02b6480d92a6-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (68116445-e206-4d7e-a5ce-57a233b51462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfcfaa4-4b71-4258-86af-8590a758e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfcfaa4-4b71-4258-86af-8590a758e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13169454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350acfbf-f679-4e5b-9c47-59578fca2ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:58Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adbbcca-1fd5-4400-860d-4e6b899f8bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adbbcca-1fd5-4400-860d-4e6b899f8bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9fef655-de31-4db7-a953-dde294ab2c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9fef655-de31-4db7-a953-dde294ab2c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '350acfbf-f679-4e5b-9c47-59578fca2ef9', 'volume_name': 'volume-350acfbf-f679-4e5b-9c47-59578fca2ef9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d5c665-78a9-4620-8e16-d4cebc541ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d5c665-78a9-4620-8e16-d4cebc541ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ab65e3-05b7-47a0-82c0-332b23c0c013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:58 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Volume 350acfbf-f679-4e5b-9c47-59578fca2ef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-350acfbf-f679-4e5b-9c47-59578fca2ef9', 'volume_size': 1} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13169454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350acfbf-f679-4e5b-9c47-59578fca2ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:58Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Creating volume 350acfbf-f679-4e5b-9c47-59578fca2ef9 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:58 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:58 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 1073741824 Sep 08 14:05:58 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:58 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 1073741824" returned: 0 in 0.601s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:58 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 Sep 08 14:05:58 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:05:59 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (59556499-480a-491f-922d-3fd15aa8f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d36a15-023a-427e-b23a-7ca66fb90a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9" returned: 0 in 0.464s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d36a15-023a-427e-b23a-7ca66fb90a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501116345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb4023c-ec59-4dd0-9a25-bc0aa58338ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:59Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6825eb7-49e0-451c-9bbb-ab27a63ca779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6825eb7-49e0-451c-9bbb-ab27a63ca779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc70dd6b-003e-4b4c-8451-d9281dba3d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc70dd6b-003e-4b4c-8451-d9281dba3d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb4023c-ec59-4dd0-9a25-bc0aa58338ae', 'volume_name': 'volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d83621-2eb2-455e-afeb-77e74ddbb09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d83621-2eb2-455e-afeb-77e74ddbb09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788ba3f8-738d-4ce9-b03d-e2e7f972d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:59 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Volume 9eb4023c-ec59-4dd0-9a25-bc0aa58338ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae', 'volume_size': 1} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501116345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb4023c-ec59-4dd0-9a25-bc0aa58338ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:05:59Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Creating volume 9eb4023c-ec59-4dd0-9a25-bc0aa58338ae {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:05:59 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ab65e3-05b7-47a0-82c0-332b23c0c013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350acfbf-f679-4e5b-9c47-59578fca2ef9', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1e507f-686f-4089-8c8d-c3448c7a050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:05:59 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae 1073741824 Sep 08 14:05:59 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:05:59 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Volume volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 (350acfbf-f679-4e5b-9c47-59578fca2ef9): created successfully Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1e507f-686f-4089-8c8d-c3448c7a050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (68116445-e206-4d7e-a5ce-57a233b51462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:05:59 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5f1d6d3e-b398-49d8-bdfa-faf08a8dedd1 tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:05:59 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae 1073741824" returned: 0 in 0.501s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:05:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:05:59 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae Sep 08 14:05:59 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:00 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" returned: 0 in 0.313s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788ba3f8-738d-4ce9-b03d-e2e7f972d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9615ec04-699d-4a90-96be-c34eb145e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:00 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Volume volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae (9eb4023c-ec59-4dd0-9a25-bc0aa58338ae): created successfully Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9615ec04-699d-4a90-96be-c34eb145e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (59556499-480a-491f-922d-3fd15aa8f75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:00 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-61541d3f-1285-4507-a36d-facfc1cab95b tempest-ProjectReaderTests-842836332 None] Created volume successfully. Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Creating offline snapshot 56815bea-630d-43bd-8174-2fbeb5b9fcf3 of volume 350acfbf-f679-4e5b-9c47-59578fca2ef9 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2921bfbc-7ddf-4198-9d90-47cd3045f714]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:00 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 Sep 08 14:06:00 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:00 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9" returned: 0 in 0.437s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:00 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 1G Sep 08 14:06:00 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:01 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 1G" returned: 0 in 0.428s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:01 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 Sep 08 14:06:01 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:01 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3" returned: 0 in 0.312s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:01 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 is being set with open permissions: ugo+rw Sep 08 14:06:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:01 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 Sep 08 14:06:01 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:01 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3" returned: 0 in 0.271s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:01 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.info Sep 08 14:06:01 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:02 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.info" returned: 0 in 0.268s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:02 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.info is being set with open permissions: ugo+rw Sep 08 14:06:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:02 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.info Sep 08 14:06:02 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:02 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.info" returned: 0 in 0.276s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.893s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:02 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Creating offline snapshot 16d19f20-a533-4440-af4c-a1b52e2a2637 of volume 9eb4023c-ec59-4dd0-9a25-bc0aa58338ae {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:02 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e1b49-554b-4573-ae22-0bc2b574f49f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:02 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:02 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-44f672b6-0b50-4fb2-96a4-21ab120d9e90 tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:06:02 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae Sep 08 14:06:02 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:03 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" returned: 0 in 0.578s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:03 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 1G Sep 08 14:06:03 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:03 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:03 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:03 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.397s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-56815bea-630d-43bd-8174-2fbeb5b9fcf3-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Lock "cinder-56815bea-630d-43bd-8174-2fbeb5b9fcf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-350acfbf-f679-4e5b-9c47-59578fca2ef9" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-350acfbf-f679-4e5b-9c47-59578fca2ef9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-56815bea-630d-43bd-8174-2fbeb5b9fcf3" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-56815bea-630d-43bd-8174-2fbeb5b9fcf3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot 56815bea-630d-43bd-8174-2fbeb5b9fcf3 of volume 350acfbf-f679-4e5b-9c47-59578fca2ef9 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:03 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 1G" returned: 0 in 0.636s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3e68a1-e172-4c3c-a4f9-91bd6e189179]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:03 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 Sep 08 14:06:03 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:03 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 Sep 08 14:06:03 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:04 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637" returned: 0 in 0.328s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:04 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 is being set with open permissions: ugo+rw Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:04 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 Sep 08 14:06:04 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:04 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3" returned: 0 in 0.460s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350acfbf-f679-4e5b-9c47-59578fca2ef9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb99b3e-8921-4fbc-ad05-1f6e30f3d903]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:04 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 Sep 08 14:06:04 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:04 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637" returned: 0 in 0.338s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:04 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.info Sep 08 14:06:04 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:04 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9" returned: 0 in 0.459s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:04 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 Sep 08 14:06:04 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:04 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.info" returned: 0 in 0.319s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:04 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.info is being set with open permissions: ugo+rw Sep 08 14:06:04 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:04 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.info Sep 08 14:06:04 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:05 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.info" returned: 0 in 0.293s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e7b45f51-bdcc-4272-aea6-fd97a6437688 tempest-ProjectReaderTests-842836332 None] Create snapshot completed successfully Sep 08 14:06:05 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3" returned: 0 in 0.479s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:05 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3 Sep 08 14:06:05 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:05 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9.56815bea-630d-43bd-8174-2fbeb5b9fcf3" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-56815bea-630d-43bd-8174-2fbeb5b9fcf3" released by "_delete_snapshot" :: held 1.841s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-350acfbf-f679-4e5b-9c47-59578fca2ef9" released by "delete_snapshot" :: held 1.877s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Created reservations ['efd3000a-3cf6-4d10-a2cd-45b3f8185be0', '30052ac4-eb27-4a24-8252-a1dcba4b6a55', '9f56b820-b412-4abf-ac4d-7e1f0022e847', '90a7c209-a834-4531-abbb-eccd6edf697b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:05 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-85dc2300-cabb-4c96-a401-5ed6e62b4767 tempest-ProjectMemberTests-837234304 None] Lock "cinder-56815bea-630d-43bd-8174-2fbeb5b9fcf3-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-350acfbf-f679-4e5b-9c47-59578fca2ef9-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:05 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Lock "cinder-350acfbf-f679-4e5b-9c47-59578fca2ef9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-350acfbf-f679-4e5b-9c47-59578fca2ef9" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-350acfbf-f679-4e5b-9c47-59578fca2ef9" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb68a322-5124-4977-973e-d8f3a4a141db]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:06 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 Sep 08 14:06:06 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-16d19f20-a533-4440-af4c-a1b52e2a2637-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Lock "cinder-16d19f20-a533-4440-af4c-a1b52e2a2637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-16d19f20-a533-4440-af4c-a1b52e2a2637" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-16d19f20-a533-4440-af4c-a1b52e2a2637" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Deleting offline snapshot 16d19f20-a533-4440-af4c-a1b52e2a2637 of volume 9eb4023c-ec59-4dd0-9a25-bc0aa58338ae {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] snapshot_file for this snap is: volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f5bc5e-0e85-4f65-b216-23d8c47064ac]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:06 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9" returned: 0 in 0.442s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:06 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 Sep 08 14:06:06 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:06 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9 Sep 08 14:06:06 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:06 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-350acfbf-f679-4e5b-9c47-59578fca2ef9" returned: 0 in 0.345s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:06 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-350acfbf-f679-4e5b-9c47-59578fca2ef9" released by "delete_volume" :: held 0.880s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:07 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637" returned: 0 in 0.578s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Created reservations ['d954b80a-4d01-4a22-bde8-03ac2ef4aab2', '0bbfdd97-3e7c-418f-a6e8-73c7e620429c', '537f2c35-5001-471c-9d87-a543715b2718', '2d36c7ee-533d-4d46-b44a-d5c7eacf3cbb'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e9e131-28e5-4cf3-9c80-e89abaf8c71d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:07 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae Sep 08 14:06:07 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:07 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:07 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:07 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" returned: 0 in 0.475s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:07 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.360s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:07 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 Sep 08 14:06:07 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:06:07 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-14d96e3e-4c7f-495f-8bf0-e6f546c52b59 tempest-ProjectMemberTests-837234304 None] Lock "cinder-350acfbf-f679-4e5b-9c47-59578fca2ef9-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:07 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637" returned: 0 in 0.406s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:07 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:07 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637 Sep 08 14:06:07 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:08 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae.16d19f20-a533-4440-af4c-a1b52e2a2637" returned: 0 in 0.338s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-16d19f20-a533-4440-af4c-a1b52e2a2637" released by "_delete_snapshot" :: held 1.941s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" released by "delete_snapshot" :: held 1.979s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Created reservations ['6758f386-98d5-44ba-8386-685d087689a6', 'a9891aa7-5878-493f-a452-cb95011b5393', 'a41aa2c9-75d2-40b0-b20f-7b580ab9ce99', '63664345-79bb-4c47-a83f-19e7b4dc6ccc'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:08 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Delete snapshot completed successfully. Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-149dc010-20df-4aa5-8f42-aa28ae8e27e0 tempest-ProjectReaderTests-842836332 None] Lock "cinder-16d19f20-a533-4440-af4c-a1b52e2a2637-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (62f4cba4-bd33-45bb-86e4-6c605b5f795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f2424a-81f1-412b-932d-f5d54b4ada47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f2424a-81f1-412b-932d-f5d54b4ada47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339190429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480185b8-18c2-4d8b-aeac-3e5027cfba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:09Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2881acdb-38c9-49b8-a39d-3215aea37dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2881acdb-38c9-49b8-a39d-3215aea37dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88acbf26-86ba-488e-8a02-416c0964a836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88acbf26-86ba-488e-8a02-416c0964a836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480185b8-18c2-4d8b-aeac-3e5027cfba73', 'volume_name': 'volume-480185b8-18c2-4d8b-aeac-3e5027cfba73', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3740c0b-2c46-42e2-817d-2ad1ea994b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3740c0b-2c46-42e2-817d-2ad1ea994b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5132a61-82fe-4573-9152-f8917ca69690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:08 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Volume 480185b8-18c2-4d8b-aeac-3e5027cfba73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480185b8-18c2-4d8b-aeac-3e5027cfba73', 'volume_size': 1} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339190429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480185b8-18c2-4d8b-aeac-3e5027cfba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:09Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Creating volume 480185b8-18c2-4d8b-aeac-3e5027cfba73 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:08 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:08 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:09 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 1073741824 Sep 08 14:06:09 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:09 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 1073741824" returned: 0 in 0.488s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:09 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 Sep 08 14:06:09 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Lock "cinder-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Flow 'volume_create_manager' (1f68be4f-7aa4-4d70-81f7-e19a97000438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ec5b02-0bcc-4726-ba5f-760b76f89930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" acquired by "delete_volume" :: waited 0.110s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ec5b02-0bcc-4726-ba5f-760b76f89930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-594034442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d927fb-b0aa-4934-ad6e-1815a1d11f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90eead6234d54d3aa8f631eb2591fdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:10Z,use_quota=True,user_id='b4e716d0cd1742f9be32ba8f5971032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4b2223-5c56-453b-ab50-f69dc6479ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4b2223-5c56-453b-ab50-f69dc6479ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e9da5c-bb30-4c63-8a4f-81f6364d9f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e9da5c-bb30-4c63-8a4f-81f6364d9f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d927fb-b0aa-4934-ad6e-1815a1d11f21', 'volume_name': 'volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd974e9-12f7-4696-93a9-8f366b16ae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd974e9-12f7-4696-93a9-8f366b16ae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:09 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949f9744-8753-40ca-9f29-dea8da27f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:09 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Volume b8d927fb-b0aa-4934-ad6e-1815a1d11f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21', 'volume_size': 1} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d223c57f-8c42-40ac-b136-9ec68dc3eb04]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73" returned: 0 in 0.397s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-594034442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d927fb-b0aa-4934-ad6e-1815a1d11f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90eead6234d54d3aa8f631eb2591fdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:10Z,use_quota=True,user_id='b4e716d0cd1742f9be32ba8f5971032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Creating volume b8d927fb-b0aa-4934-ad6e-1815a1d11f21 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:09 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5132a61-82fe-4573-9152-f8917ca69690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480185b8-18c2-4d8b-aeac-3e5027cfba73', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b209c370-3fd1-49e2-8ed9-acc23ef5710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:09 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 1073741824 Sep 08 14:06:09 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:09 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Volume volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 (480185b8-18c2-4d8b-aeac-3e5027cfba73): created successfully Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b209c370-3fd1-49e2-8ed9-acc23ef5710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:09 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (62f4cba4-bd33-45bb-86e4-6c605b5f795b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:10 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-98a69e17-b0fd-416a-80c1-ff676afa6db2 tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:06:10 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae Sep 08 14:06:10 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:10 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" returned: 0 in 0.481s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:10 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae Sep 08 14:06:10 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:10 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 1073741824" returned: 0 in 0.589s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:10 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 Sep 08 14:06:10 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:10 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" returned: 0 in 0.297s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae" released by "delete_volume" :: held 0.881s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Created reservations ['25a3f2eb-e923-4e8d-a797-fe871705c85c', '3e4305b5-c6e4-4e7c-9472-bdcda4436d6b', '99e9f2b3-4166-4aa0-b727-9f3ce4f8ee88', 'c1c9b1e3-3203-4fcc-be82-4b0abf9f3808'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:10 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:10 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:10 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21" returned: 0 in 0.346s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949f9744-8753-40ca-9f29-dea8da27f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174362f7-4057-401b-9de6-9b39c7b06b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:10 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Volume volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 (b8d927fb-b0aa-4934-ad6e-1815a1d11f21): created successfully Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174362f7-4057-401b-9de6-9b39c7b06b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:10 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Flow 'volume_create_manager' (1f68be4f-7aa4-4d70-81f7-e19a97000438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0da9c6d3-58ab-4a38-9dda-e324ba9e19a3 tempest-ProjectReaderTests-777560088 None] Created volume successfully. Sep 08 14:06:11 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.343s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:11 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Deleted volume successfully. Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Creating offline snapshot 504a09d1-6154-49c7-913f-e5a0ac15136c of volume 480185b8-18c2-4d8b-aeac-3e5027cfba73 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[411d0b1e-c64d-46c8-b847-9f3f43c7dc1c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7de8f60-0157-4e3c-8abc-ce45624fa959 tempest-ProjectReaderTests-842836332 None] Lock "cinder-9eb4023c-ec59-4dd0-9a25-bc0aa58338ae-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:11 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 Sep 08 14:06:11 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:11 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73" returned: 0 in 0.388s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:11 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:11 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c 1G Sep 08 14:06:11 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:12 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c 1G" returned: 0 in 0.540s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:12 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c Sep 08 14:06:12 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Acquiring lock "cinder-b8d927fb-b0aa-4934-ad6e-1815a1d11f21-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Lock "cinder-b8d927fb-b0aa-4934-ad6e-1815a1d11f21-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Acquiring lock "cinder-quobyte-b8d927fb-b0aa-4934-ad6e-1815a1d11f21" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Lock "cinder-quobyte-b8d927fb-b0aa-4934-ad6e-1815a1d11f21" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20af3df-727a-45de-9120-a9d0cd7b018b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:12 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 Sep 08 14:06:12 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (271f3fbe-5127-43f1-9940-b7c528c82cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dd58f5-40fd-44f8-8ada-e43d43c8f439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:12 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dd58f5-40fd-44f8-8ada-e43d43c8f439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896001319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb3926b-c531-4ca7-97a0-42a7f3af9152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:13Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5775450-2afe-468d-9f04-ece1c40d099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5775450-2afe-468d-9f04-ece1c40d099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e743bd9e-6710-429c-be4f-a59e4c7ca90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e743bd9e-6710-429c-be4f-a59e4c7ca90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb3926b-c531-4ca7-97a0-42a7f3af9152', 'volume_name': 'volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2956f55f-d1f8-4867-a408-3ca29cd2c626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2956f55f-d1f8-4867-a408-3ca29cd2c626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc3aff9-a2b6-4d08-84e6-0b84985e900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:12 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Volume ceb3926b-c531-4ca7-97a0-42a7f3af9152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152', 'volume_size': 1} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c" returned: 0 in 0.544s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:12 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c is being set with open permissions: ugo+rw Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:12 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c Sep 08 14:06:12 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:12 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21" returned: 0 in 0.465s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:12 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:12 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21 Sep 08 14:06:12 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:13 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c" returned: 0 in 0.312s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:13 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.info Sep 08 14:06:13 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:13 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-b8d927fb-b0aa-4934-ad6e-1815a1d11f21" returned: 0 in 0.275s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Lock "cinder-quobyte-b8d927fb-b0aa-4934-ad6e-1815a1d11f21" released by "delete_volume" :: held 0.799s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Created reservations ['9b9d96cc-9499-4fa9-bbb7-29c3a49036cd', '7351f3f6-42db-43e4-af1e-8ab5c78f4ac2', '873d9280-7205-4599-9660-4852b01726c1', '52aeaf69-424d-4b6d-8f16-b059e4732d6f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:13 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.info" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:13 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.info is being set with open permissions: ugo+rw Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:13 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:13 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:13 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.info Sep 08 14:06:13 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:13 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.289s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Deleted volume successfully. Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-7181312d-9825-4147-8139-241e32e6f53e tempest-ProjectReaderTests-777560088 None] Lock "cinder-b8d927fb-b0aa-4934-ad6e-1815a1d11f21-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:13 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.info" returned: 0 in 0.357s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896001319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb3926b-c531-4ca7-97a0-42a7f3af9152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:13Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Creating volume ceb3926b-c531-4ca7-97a0-42a7f3af9152 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:13 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:13 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:13 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 1073741824 Sep 08 14:06:13 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:13 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e651de9d-e8d3-4993-b414-ecbb13b4fc83 tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Flow 'volume_create_manager' (129b8817-d7a5-49b6-b233-909bfed8dc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894181aa-f080-4ac1-ad9d-22d4ff6f1605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894181aa-f080-4ac1-ad9d-22d4ff6f1605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329208248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff03b2bd-9362-4925-b12c-14692a761afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90eead6234d54d3aa8f631eb2591fdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:14Z,use_quota=True,user_id='b4e716d0cd1742f9be32ba8f5971032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a472b63b-2119-4c35-99b9-ad9a6b7b5cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a472b63b-2119-4c35-99b9-ad9a6b7b5cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfab58c-6d0b-4c62-8e48-4f752936a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfab58c-6d0b-4c62-8e48-4f752936a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff03b2bd-9362-4925-b12c-14692a761afd', 'volume_name': 'volume-ff03b2bd-9362-4925-b12c-14692a761afd', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1eb984-5de2-44b3-b23c-de8d96a36dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1eb984-5de2-44b3-b23c-de8d96a36dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792512ab-0c02-475b-bf34-84bdc112add3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:14 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Volume ff03b2bd-9362-4925-b12c-14692a761afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff03b2bd-9362-4925-b12c-14692a761afd', 'volume_size': 1} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:14 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 1073741824" returned: 0 in 0.535s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:14 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 Sep 08 14:06:14 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-504a09d1-6154-49c7-913f-e5a0ac15136c-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Lock "cinder-504a09d1-6154-49c7-913f-e5a0ac15136c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-480185b8-18c2-4d8b-aeac-3e5027cfba73" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-480185b8-18c2-4d8b-aeac-3e5027cfba73" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-504a09d1-6154-49c7-913f-e5a0ac15136c" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:14 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152" returned: 0 in 0.272s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329208248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff03b2bd-9362-4925-b12c-14692a761afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90eead6234d54d3aa8f631eb2591fdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:14Z,use_quota=True,user_id='b4e716d0cd1742f9be32ba8f5971032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Creating volume ff03b2bd-9362-4925-b12c-14692a761afd {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:14 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:14 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd 1073741824 Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-504a09d1-6154-49c7-913f-e5a0ac15136c" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:14 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot 504a09d1-6154-49c7-913f-e5a0ac15136c of volume 480185b8-18c2-4d8b-aeac-3e5027cfba73 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc3aff9-a2b6-4d08-84e6-0b84985e900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0909da33-1316-4c74-b46f-b88a7f6d8c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[083aeb72-4b1e-46d1-ba75-a9a0dadb285d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:14 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Volume volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 (ceb3926b-c531-4ca7-97a0-42a7f3af9152): created successfully Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0909da33-1316-4c74-b46f-b88a7f6d8c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:14 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (271f3fbe-5127-43f1-9940-b7c528c82cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:14 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-5b20d301-0acf-490c-bf9d-57fcc4273c6e tempest-ProjectReaderTests-842836332 None] Created volume successfully. Sep 08 14:06:14 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c Sep 08 14:06:14 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:15 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c" returned: 0 in 0.405s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-480185b8-18c2-4d8b-aeac-3e5027cfba73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:15 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd 1073741824" returned: 0 in 0.513s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[0740dea8-c1a3-4aaa-8b10-3781a804b061]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:15 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd Sep 08 14:06:15 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:15 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 Sep 08 14:06:15 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:15 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd" returned: 0 in 0.285s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792512ab-0c02-475b-bf34-84bdc112add3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff03b2bd-9362-4925-b12c-14692a761afd', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469fbf3d-6a4e-4f8f-bd8a-08884aa5b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:15 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Volume volume-ff03b2bd-9362-4925-b12c-14692a761afd (ff03b2bd-9362-4925-b12c-14692a761afd): created successfully Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469fbf3d-6a4e-4f8f-bd8a-08884aa5b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Flow 'volume_create_manager' (129b8817-d7a5-49b6-b233-909bfed8dc14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:15 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e6c961d2-1da1-40a4-9b11-a0852a87284e tempest-ProjectReaderTests-777560088 None] Created volume successfully. Sep 08 14:06:15 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73" returned: 0 in 0.385s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:15 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c Sep 08 14:06:15 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Creating offline snapshot 14844698-f219-4dbf-a6ab-2454d1d79d39 of volume ceb3926b-c531-4ca7-97a0-42a7f3af9152 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e915dd-a0ea-4eef-bb99-01897c27bd6b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:15 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c" returned: 0 in 0.396s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:15 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:15 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c Sep 08 14:06:15 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:16 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 Sep 08 14:06:16 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:16 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73.504a09d1-6154-49c7-913f-e5a0ac15136c" returned: 0 in 0.285s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Acquiring lock "cinder-ff03b2bd-9362-4925-b12c-14692a761afd-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-504a09d1-6154-49c7-913f-e5a0ac15136c" released by "_delete_snapshot" :: held 1.619s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-480185b8-18c2-4d8b-aeac-3e5027cfba73" released by "delete_snapshot" :: held 1.702s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Lock "cinder-ff03b2bd-9362-4925-b12c-14692a761afd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Acquiring lock "cinder-quobyte-ff03b2bd-9362-4925-b12c-14692a761afd" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:16 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Lock "cinder-quobyte-ff03b2bd-9362-4925-b12c-14692a761afd" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152" returned: 0 in 0.483s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b275a-5705-428f-9363-1352cf6ea22d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:16 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 1G Sep 08 14:06:16 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Created reservations ['ad5e3f27-7738-42e0-8c6e-f6a8eb49bcf8', '72488b57-110c-422b-98cd-03e305ff61fe', '8d8aee1a-8877-42d9-9f22-0bc4833d9b00', '090d2ef8-6d6d-43a9-b26e-98e5fe661587'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:16 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-05c6233e-3383-426a-8807-a6e5648ed500 tempest-ProjectMemberTests-837234304 None] Lock "cinder-504a09d1-6154-49c7-913f-e5a0ac15136c-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:16 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd Sep 08 14:06:16 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-480185b8-18c2-4d8b-aeac-3e5027cfba73-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Lock "cinder-480185b8-18c2-4d8b-aeac-3e5027cfba73-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-480185b8-18c2-4d8b-aeac-3e5027cfba73" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-480185b8-18c2-4d8b-aeac-3e5027cfba73" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ed564-614e-48cc-8ab9-53f4d3165e5f]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:16 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:16 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd" returned: 0 in 0.581s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:17 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 1G" returned: 0 in 0.629s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:17 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd Sep 08 14:06:17 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:17 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 Sep 08 14:06:17 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:17 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 Sep 08 14:06:17 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:17 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ff03b2bd-9362-4925-b12c-14692a761afd" returned: 0 in 0.395s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:17 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73" returned: 0 in 0.449s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:17 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Lock "cinder-quobyte-ff03b2bd-9362-4925-b12c-14692a761afd" released by "delete_volume" :: held 1.071s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39" returned: 0 in 0.435s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:17 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 is being set with open permissions: ugo+rw Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:17 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73 Sep 08 14:06:17 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:17 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 Sep 08 14:06:17 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Created reservations ['b9c0420c-336d-402c-972d-a82b47287adf', '0878fe4c-a212-46f2-b7f3-ce068a79b7c7', '888e9fa3-ea81-40ec-9bf2-0314903d09cf', 'f80a41e0-c81f-4465-9c06-d1d32a6cda67'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:17 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:17 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:17 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39" returned: 0 in 0.352s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:17 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-480185b8-18c2-4d8b-aeac-3e5027cfba73" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:17 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-480185b8-18c2-4d8b-aeac-3e5027cfba73" released by "delete_volume" :: held 0.974s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:17 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.info Sep 08 14:06:17 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Created reservations ['856c9476-1c36-46ab-a646-12ae7508e7cc', 'd4a6cc7c-839d-4dba-a0e1-eff8c40c816a', '8322014e-a725-4c6c-be5c-6c2c0ecf7a2b', 'fc3e8c33-d9e6-4f38-a05c-492bcea62081'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:18 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.382s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Deleted volume successfully. Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-b2beda90-6418-44d4-aaaa-9596140badef tempest-ProjectReaderTests-777560088 None] Lock "cinder-ff03b2bd-9362-4925-b12c-14692a761afd-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:18 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:18 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:18 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.info" returned: 0 in 0.392s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:18 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.info is being set with open permissions: ugo+rw Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:18 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.info Sep 08 14:06:18 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:18 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-0e54f30b-c5f3-4328-8459-5f7ff3aab90a tempest-ProjectMemberTests-837234304 None] Lock "cinder-480185b8-18c2-4d8b-aeac-3e5027cfba73-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:18 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.info" returned: 0 in 0.325s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:18 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.752s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:18 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-3718fbe3-cb81-4058-b4aa-d6f31b1afc0a tempest-ProjectReaderTests-842836332 None] Create snapshot completed successfully Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-14844698-f219-4dbf-a6ab-2454d1d79d39-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Lock "cinder-14844698-f219-4dbf-a6ab-2454d1d79d39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-ceb3926b-c531-4ca7-97a0-42a7f3af9152" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-ceb3926b-c531-4ca7-97a0-42a7f3af9152" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-14844698-f219-4dbf-a6ab-2454d1d79d39" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Flow 'volume_create_manager' (df53614d-3064-4d83-bc09-31137cde1f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafae67d-ecab-492a-a47f-fb98c6455607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafae67d-ecab-492a-a47f-fb98c6455607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-676476523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca4ca30-6d93-4345-84bf-9414780329b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90eead6234d54d3aa8f631eb2591fdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:19Z,use_quota=True,user_id='b4e716d0cd1742f9be32ba8f5971032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eab3a40-2192-4da7-a5cc-c3454029b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eab3a40-2192-4da7-a5cc-c3454029b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c8382c-d610-4a8a-8e87-e0cdb0092ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c8382c-d610-4a8a-8e87-e0cdb0092ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca4ca30-6d93-4345-84bf-9414780329b6', 'volume_name': 'volume-cca4ca30-6d93-4345-84bf-9414780329b6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10bc8a51-1a0a-4b4a-9692-0b4f4f8759b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10bc8a51-1a0a-4b4a-9692-0b4f4f8759b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9d4f74-a6b7-4240-8246-66d3151d996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Volume cca4ca30-6d93-4345-84bf-9414780329b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca4ca30-6d93-4345-84bf-9414780329b6', 'volume_size': 1} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-676476523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca4ca30-6d93-4345-84bf-9414780329b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90eead6234d54d3aa8f631eb2591fdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:19Z,use_quota=True,user_id='b4e716d0cd1742f9be32ba8f5971032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Creating volume cca4ca30-6d93-4345-84bf-9414780329b6 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:19 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-14844698-f219-4dbf-a6ab-2454d1d79d39" acquired by "_delete_snapshot" :: waited 0.128s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Deleting offline snapshot 14844698-f219-4dbf-a6ab-2454d1d79d39 of volume ceb3926b-c531-4ca7-97a0-42a7f3af9152 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:19 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 1073741824 Sep 08 14:06:19 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] snapshot_file for this snap is: volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a36033c-09c1-4dc2-93ae-28ebc421ceea]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:19 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 Sep 08 14:06:19 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (89422fb4-d448-421a-9f6a-d9db57f56949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230177de-e509-487c-9b86-e352504d033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230177de-e509-487c-9b86-e352504d033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623310448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c74aed3-b940-4d42-81ca-0d1fd8ecfd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:20Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05269615-55cb-499f-b287-86b604353ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05269615-55cb-499f-b287-86b604353ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73d0c4b-05e2-4421-8680-2325a87b4d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73d0c4b-05e2-4421-8680-2325a87b4d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c74aed3-b940-4d42-81ca-0d1fd8ecfd38', 'volume_name': 'volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fedc824-f8f4-4df6-87b4-3f4cb421683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fedc824-f8f4-4df6-87b4-3f4cb421683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dadbb50-f879-4e21-ac56-0347282227ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Volume 8c74aed3-b940-4d42-81ca-0d1fd8ecfd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38', 'volume_size': 1} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 1073741824" returned: 0 in 0.613s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:20 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 Sep 08 14:06:20 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:20 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39" returned: 0 in 0.649s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4933483e-a9d5-48d1-98c9-2c1805c10c15]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:20 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 Sep 08 14:06:20 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:20 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6" returned: 0 in 0.373s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623310448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c74aed3-b940-4d42-81ca-0d1fd8ecfd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:20Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Creating volume 8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:20 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9d4f74-a6b7-4240-8246-66d3151d996d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca4ca30-6d93-4345-84bf-9414780329b6', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43f10b0-54fe-46dd-a329-12b67044a559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:20 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 1073741824 Sep 08 14:06:20 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:20 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Volume volume-cca4ca30-6d93-4345-84bf-9414780329b6 (cca4ca30-6d93-4345-84bf-9414780329b6): created successfully Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43f10b0-54fe-46dd-a329-12b67044a559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Flow 'volume_create_manager' (df53614d-3064-4d83-bc09-31137cde1f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:20 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-55303d93-4db1-49c6-86a6-d8d4ca0aa5b0 tempest-ProjectReaderTests-777560088 None] Created volume successfully. Sep 08 14:06:20 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:20 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:20 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 Sep 08 14:06:20 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:21 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 1073741824" returned: 0 in 0.649s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:21 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:21 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 Sep 08 14:06:21 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39" returned: 0 in 0.565s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:21 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39 Sep 08 14:06:21 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:21 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" returned: 0 in 0.327s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dadbb50-f879-4e21-ac56-0347282227ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78ecdff-ff1d-4d46-b014-a87bdf7d7b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:21 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152.14844698-f219-4dbf-a6ab-2454d1d79d39" returned: 0 in 0.341s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Acquiring lock "cinder-cca4ca30-6d93-4345-84bf-9414780329b6-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:21 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Volume volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 (8c74aed3-b940-4d42-81ca-0d1fd8ecfd38): created successfully Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78ecdff-ff1d-4d46-b014-a87bdf7d7b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (89422fb4-d448-421a-9f6a-d9db57f56949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-14844698-f219-4dbf-a6ab-2454d1d79d39" released by "_delete_snapshot" :: held 2.186s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-ceb3926b-c531-4ca7-97a0-42a7f3af9152" released by "delete_snapshot" :: held 2.339s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Lock "cinder-cca4ca30-6d93-4345-84bf-9414780329b6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:21 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-84247231-86e9-44ad-b31e-7463b4be6e64 tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Acquiring lock "cinder-quobyte-cca4ca30-6d93-4345-84bf-9414780329b6" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Lock "cinder-quobyte-cca4ca30-6d93-4345-84bf-9414780329b6" acquired by "delete_volume" :: waited 0.037s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ceb2f9-f508-416d-a2df-664cdb3b622d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Created reservations ['a053714f-ef08-4b29-a3eb-8bffedb18dec', '819d19df-5f9c-4081-b8c0-aacbb20c67b6', '3313644b-ab33-41b7-a00a-2c3f26cf9a1e', '3ae6f6fa-d87b-48a8-8353-ca89367a18bf'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:21 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Delete snapshot completed successfully. Sep 08 14:06:21 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a981c4b0-4437-4220-87dc-67fb18c7411e tempest-ProjectReaderTests-842836332 None] Lock "cinder-14844698-f219-4dbf-a6ab-2454d1d79d39-delete_snapshot" released by "delete_snapshot" :: held 2.685s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:21 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 Sep 08 14:06:21 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:22 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6" returned: 0 in 0.448s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:22 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6 Sep 08 14:06:22 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Creating offline snapshot 9e84de52-8488-48ec-a639-f1f632784f23 of volume 8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Flow 'volume_create_manager' (d3bd85be-dc57-4aae-baf2-8cc9bb4f08ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cde9a6-82f7-40c6-86f5-0ca448f13d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5349e1-ed2a-44f6-9b37-74c76c88f7f2]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cde9a6-82f7-40c6-86f5-0ca448f13d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1044800927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc19d3d-73e9-4c7f-9ca1-644907b15f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485e3baa5814e52ac90c07d92b11bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:22Z,use_quota=True,user_id='5b780b71ada549e488e74dccc9b7866f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6ffdd7-f2d4-47ae-ba64-2e4f378ae5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6ffdd7-f2d4-47ae-ba64-2e4f378ae5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074c46eb-77b9-4ce3-9f72-2a631de083f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074c46eb-77b9-4ce3-9f72-2a631de083f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc19d3d-73e9-4c7f-9ca1-644907b15f6b', 'volume_name': 'volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:22 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5abdd9-3179-4c32-a9ac-fe25ad1b42d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5abdd9-3179-4c32-a9ac-fe25ad1b42d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a03e42-d55f-4e81-8213-823c93802884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:22 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Volume ecc19d3d-73e9-4c7f-9ca1-644907b15f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b', 'volume_size': 1} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-cca4ca30-6d93-4345-84bf-9414780329b6" returned: 0 in 0.294s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Lock "cinder-quobyte-cca4ca30-6d93-4345-84bf-9414780329b6" released by "delete_volume" :: held 0.795s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:22 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 Sep 08 14:06:22 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-ceb3926b-c531-4ca7-97a0-42a7f3af9152-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Lock "cinder-ceb3926b-c531-4ca7-97a0-42a7f3af9152-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Created reservations ['f6364c31-7f8e-4c58-b6ce-8ba03bf47408', '13c9ab54-944f-4bf3-a4e1-cf01879c3151', '5bace5d6-9871-4fd2-89cb-d3ab073f4d73', 'a5f821b8-7a37-4453-abfb-9d8af80a2d7a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-ceb3926b-c531-4ca7-97a0-42a7f3af9152" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-ceb3926b-c531-4ca7-97a0-42a7f3af9152" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[7577af07-e3b3-4c60-8462-31d1b99a5e02]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:22 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:22 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:22 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 Sep 08 14:06:22 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:22 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" returned: 0 in 0.421s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:22 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 1G Sep 08 14:06:22 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:22 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.270s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:22 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Deleted volume successfully. Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-295c5610-bf51-4640-9391-928c5a5f4ef3 tempest-ProjectReaderTests-777560088 None] Lock "cinder-cca4ca30-6d93-4345-84bf-9414780329b6-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:23 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152" returned: 0 in 0.446s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:23 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152 Sep 08 14:06:23 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Flow 'volume_create_manager' (543f7870-18a4-4bd7-9828-8a7f94965ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd98ebb-3211-4309-b77d-43862d7ca4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd98ebb-3211-4309-b77d-43862d7ca4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205082053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f282dea2-942e-4c39-9920-253d6218a65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90eead6234d54d3aa8f631eb2591fdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:23Z,use_quota=True,user_id='b4e716d0cd1742f9be32ba8f5971032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4df46b-7ef3-4744-9a50-cc43828e1000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4df46b-7ef3-4744-9a50-cc43828e1000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f426d20-3b6f-4e5c-ba67-860c8ba1bab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f426d20-3b6f-4e5c-ba67-860c8ba1bab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f282dea2-942e-4c39-9920-253d6218a65b', 'volume_name': 'volume-f282dea2-942e-4c39-9920-253d6218a65b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:23 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3beae91a-d9ee-46b2-9442-b20df8fb183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3beae91a-d9ee-46b2-9442-b20df8fb183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6faaa3-39bd-4e9f-9231-187d15790f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:23 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Volume f282dea2-942e-4c39-9920-253d6218a65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f282dea2-942e-4c39-9920-253d6218a65b', 'volume_size': 1} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 1G" returned: 0 in 0.485s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:23 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 Sep 08 14:06:23 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:23 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ceb3926b-c531-4ca7-97a0-42a7f3af9152" returned: 0 in 0.281s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-ceb3926b-c531-4ca7-97a0-42a7f3af9152" released by "delete_volume" :: held 0.801s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Created reservations ['38dffb59-9892-42e1-9450-56cb175aa924', 'bee2acf4-1075-4ff3-90d0-e18492626bd9', '5a42549c-7d83-4a32-81b2-4a7d0fa90534', '52f77158-044b-49fc-ae07-1aa067a65134'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:23 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:23 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:23 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23" returned: 0 in 0.296s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:23 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 is being set with open permissions: ugo+rw Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:23 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 Sep 08 14:06:23 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:23 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.252s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:23 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Deleted volume successfully. Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c2654544-ea6a-40bf-851a-f097d1aa826c tempest-ProjectReaderTests-842836332 None] Lock "cinder-ceb3926b-c531-4ca7-97a0-42a7f3af9152-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:23 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23" returned: 0 in 0.253s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:23 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:23 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.info Sep 08 14:06:23 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:24 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.info" returned: 0 in 0.280s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:24 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.info is being set with open permissions: ugo+rw Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:24 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.info Sep 08 14:06:24 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (f050de66-2659-4377-a7f5-687d0874ae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76b555a-3578-4b98-8931-20a3b957cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76b555a-3578-4b98-8931-20a3b957cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182843752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214705a4-8a5f-49ae-a796-3ca980620254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:24Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d53f8e-14f9-484b-8956-c9ebf6951c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d53f8e-14f9-484b-8956-c9ebf6951c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64ef3ac-231f-4e45-8458-4d589e62041a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64ef3ac-231f-4e45-8458-4d589e62041a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '214705a4-8a5f-49ae-a796-3ca980620254', 'volume_name': 'volume-214705a4-8a5f-49ae-a796-3ca980620254', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a24c82-ee39-4c19-8e59-84c57a83ab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a24c82-ee39-4c19-8e59-84c57a83ab91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b8efc2-3a6c-438a-98c7-939400ed669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:24 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Volume 214705a4-8a5f-49ae-a796-3ca980620254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-214705a4-8a5f-49ae-a796-3ca980620254', 'volume_size': 1} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:24 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.info" returned: 0 in 0.238s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.947s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1044800927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc19d3d-73e9-4c7f-9ca1-644907b15f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485e3baa5814e52ac90c07d92b11bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:22Z,use_quota=True,user_id='5b780b71ada549e488e74dccc9b7866f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Creating volume ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:24 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:24 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b 1073741824 Sep 08 14:06:24 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:24 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-97155004-0729-4c4d-bf2e-4006c86b1ef9 tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:06:24 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b 1073741824" returned: 0 in 0.391s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:24 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:24 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b Sep 08 14:06:24 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:25 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" returned: 0 in 0.234s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205082053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f282dea2-942e-4c39-9920-253d6218a65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90eead6234d54d3aa8f631eb2591fdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:23Z,use_quota=True,user_id='b4e716d0cd1742f9be32ba8f5971032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Creating volume f282dea2-942e-4c39-9920-253d6218a65b {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:25 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a03e42-d55f-4e81-8213-823c93802884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:25 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b 1073741824 Sep 08 14:06:25 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d54bf5-f44c-4927-99d0-ae223951413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:25 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Volume volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b (ecc19d3d-73e9-4c7f-9ca1-644907b15f6b): created successfully Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d54bf5-f44c-4927-99d0-ae223951413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Flow 'volume_create_manager' (d3bd85be-dc57-4aae-baf2-8cc9bb4f08ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:25 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-351b325b-a19c-4814-a7a0-3c1197bd2e42 tempest-SnapshotDependencyTests-1867790592 None] Created volume successfully. Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-9e84de52-8488-48ec-a639-f1f632784f23-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Lock "cinder-9e84de52-8488-48ec-a639-f1f632784f23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-9e84de52-8488-48ec-a639-f1f632784f23" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-9e84de52-8488-48ec-a639-f1f632784f23" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot 9e84de52-8488-48ec-a639-f1f632784f23 of volume 8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a998c232-61ce-411a-a56f-e14ca203404d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:25 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 Sep 08 14:06:25 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:25 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b 1073741824" returned: 0 in 0.510s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:25 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b Sep 08 14:06:25 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:25 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23" returned: 0 in 0.396s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f6a7a5-f194-49b2-807a-e9a6d204dada]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:25 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 Sep 08 14:06:25 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:25 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.660s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182843752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214705a4-8a5f-49ae-a796-3ca980620254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:24Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Creating volume 214705a4-8a5f-49ae-a796-3ca980620254 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:25 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:25 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6faaa3-39bd-4e9f-9231-187d15790f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f282dea2-942e-4c39-9920-253d6218a65b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:26 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 1073741824 Sep 08 14:06:26 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5774b434-a763-45ca-b17e-2a6bf01bc49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Volume volume-f282dea2-942e-4c39-9920-253d6218a65b (f282dea2-942e-4c39-9920-253d6218a65b): created successfully Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5774b434-a763-45ca-b17e-2a6bf01bc49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Flow 'volume_create_manager' (543f7870-18a4-4bd7-9828-8a7f94965ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ba34a3ab-ffd3-47fa-9e4c-a8ec1e71cbbc tempest-ProjectReaderTests-777560088 None] Created volume successfully. Sep 08 14:06:26 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" returned: 0 in 0.359s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:26 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 Sep 08 14:06:26 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:26 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 1073741824" returned: 0 in 0.451s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Acquiring lock "cinder-f282dea2-942e-4c39-9920-253d6218a65b-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Lock "cinder-f282dea2-942e-4c39-9920-253d6218a65b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Acquiring lock "cinder-quobyte-f282dea2-942e-4c39-9920-253d6218a65b" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:26 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 Sep 08 14:06:26 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Lock "cinder-quobyte-f282dea2-942e-4c39-9920-253d6218a65b" acquired by "delete_volume" :: waited 0.022s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0251d-4b43-4ee7-bedc-a786b24703ea]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:26 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23" returned: 0 in 0.398s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:26 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23 Sep 08 14:06:26 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:26 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b Sep 08 14:06:26 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:26 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.058s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b8efc2-3a6c-438a-98c7-939400ed669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214705a4-8a5f-49ae-a796-3ca980620254', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7db212-3fef-43e5-ae71-0c9f5e6091ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Creating offline snapshot c2a5b403-8db1-4bda-9550-b674de597725 of volume ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:26 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Volume volume-214705a4-8a5f-49ae-a796-3ca980620254 (214705a4-8a5f-49ae-a796-3ca980620254): created successfully Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7db212-3fef-43e5-ae71-0c9f5e6091ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (f050de66-2659-4377-a7f5-687d0874ae7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2e387-4f35-4b7f-88fc-b313cd2b0f4c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:26 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-50416f9c-2b0a-44af-8f33-bda0a58c37d7 tempest-ProjectReaderTests-842836332 None] Created volume successfully. Sep 08 14:06:26 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38.9e84de52-8488-48ec-a639-f1f632784f23" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-9e84de52-8488-48ec-a639-f1f632784f23" released by "_delete_snapshot" :: held 1.529s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" released by "delete_snapshot" :: held 1.554s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:26 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b Sep 08 14:06:26 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:26 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b" returned: 0 in 0.411s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:26 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:27 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b Sep 08 14:06:27 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Created reservations ['ea844902-50ad-4ce6-a1b4-410e11d73a4e', '5918131d-9fc8-435d-9a1d-7f0eedd64e93', '20744783-0f36-4873-a661-1c2b4fc5cc67', 'b72561d9-285a-49b0-a1de-1217bd96c44a'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1b2ccd84-cbb2-48e5-9aed-b701be49e318 tempest-ProjectMemberTests-837234304 None] Lock "cinder-9e84de52-8488-48ec-a639-f1f632784f23-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:27 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:27 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" returned: 0 in 0.379s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f282dea2-942e-4c39-9920-253d6218a65b" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:27 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 1G Sep 08 14:06:27 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Lock "cinder-quobyte-f282dea2-942e-4c39-9920-253d6218a65b" released by "delete_volume" :: held 0.715s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Created reservations ['b9b4f0e6-77ec-4fd0-874f-ca41ba91019f', '07b753c4-4ab2-427a-a393-2e22eac3a63a', '8a9291dc-ce0c-48ef-8102-de16330696ae', '716912d7-a67d-48a5-9305-a3421077459d'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:27 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:27 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Lock "cinder-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" acquired by "delete_volume" :: waited 0.042s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a55c60-7392-4886-ba82-ca3bf8d2ef9d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:27 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.348s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:27 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Deleted volume successfully. Sep 08 14:06:27 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 1G" returned: 0 in 0.592s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:27 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d4c8b500-40cc-4ba4-8fae-818eef86f17c tempest-ProjectReaderTests-777560088 None] Lock "cinder-f282dea2-942e-4c39-9920-253d6218a65b-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:27 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 Sep 08 14:06:27 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:27 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 Sep 08 14:06:27 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:28 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" returned: 0 in 0.397s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:28 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725" returned: 0 in 0.329s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:28 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 is being set with open permissions: ugo+rw Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:28 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38 Sep 08 14:06:28 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:28 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 Sep 08 14:06:28 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:28 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" returned: 0 in 0.255s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38" released by "delete_volume" :: held 0.735s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:28 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Created reservations ['10aa7202-a687-4ecc-8251-36833b5ee27f', 'bd8b62b5-ae86-4471-9e9b-7f45c75c4dc9', '03ee7206-1440-4eae-ba93-13baccab372f', 'e7937b1a-bdaf-4064-b1ad-cbedb48211cc'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:28 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.info Sep 08 14:06:28 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:28 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:28 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:28 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.info" returned: 0 in 0.336s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:28 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.info is being set with open permissions: ugo+rw Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:28 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.info Sep 08 14:06:28 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:28 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.297s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:28 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:06:28 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-612058f0-0c59-4263-8d89-6be8a004c530 tempest-ProjectMemberTests-837234304 None] Lock "cinder-8c74aed3-b940-4d42-81ca-0d1fd8ecfd38-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:29 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.info" returned: 0 in 0.279s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.552s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Creating offline snapshot 5f1b0ea1-8a85-4266-a106-666ece014819 of volume 214705a4-8a5f-49ae-a796-3ca980620254 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a3ac48-38f4-4ac2-84c3-bd51bbe44a7b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:29 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ce14d020-153a-4590-90f7-37d6ac4297a2 tempest-SnapshotDependencyTests-1867790592 None] Create snapshot completed successfully Sep 08 14:06:29 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 Sep 08 14:06:29 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (8d64a250-a8bf-489b-88a6-d2ece61940a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8458554b-accf-4dae-b508-5668cc01dd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8458554b-accf-4dae-b508-5668cc01dd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168754618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f0977f-ba85-4b9a-a809-f866f5a46439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:29Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3903df00-dc95-472a-b5ba-7ff4e9ee20bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3903df00-dc95-472a-b5ba-7ff4e9ee20bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113dc004-ed3f-4f44-a5f1-e2e91a8c6f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113dc004-ed3f-4f44-a5f1-e2e91a8c6f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f0977f-ba85-4b9a-a809-f866f5a46439', 'volume_name': 'volume-31f0977f-ba85-4b9a-a809-f866f5a46439', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ae0d6d-0f62-493e-be94-4af99ac9fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ae0d6d-0f62-493e-be94-4af99ac9fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53023a12-0408-4898-bf0a-e5104b9e6066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:29 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Volume 31f0977f-ba85-4b9a-a809-f866f5a46439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f0977f-ba85-4b9a-a809-f866f5a46439', 'volume_size': 1} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:29 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254" returned: 0 in 0.431s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:29 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:29 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 1G Sep 08 14:06:29 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:30 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 1G" returned: 0 in 0.404s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214705a4-8a5f-49ae-a796-3ca980620254 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:30 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214705a4-8a5f-49ae-a796-3ca980620254 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 Sep 08 14:06:30 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:30 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214705a4-8a5f-49ae-a796-3ca980620254 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819" returned: 0 in 0.336s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:30 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 is being set with open permissions: ugo+rw Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:30 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 Sep 08 14:06:30 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Flow 'volume_create_manager' (2e1b73fa-aa1a-4a17-94ca-19484e340aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75c635d-2c85-482a-9190-f5cec337db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75c635d-2c85-482a-9190-f5cec337db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485e3baa5814e52ac90c07d92b11bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2a5b403-8db1-4bda-9550-b674de597725,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:30Z,use_quota=True,user_id='5b780b71ada549e488e74dccc9b7866f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a344b04-6020-4d97-8cac-2dfc1217dd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a344b04-6020-4d97-8cac-2dfc1217dd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef315576-f869-4806-a66e-af4cf0621516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef315576-f869-4806-a66e-af4cf0621516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a', 'volume_name': 'volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a', 'volume_size': 1, 'snapshot_id': 'c2a5b403-8db1-4bda-9550-b674de597725'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f0a2c-0602-477f-ab11-f5fa2f76183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:30 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f0a2c-0602-477f-ab11-f5fa2f76183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83b69f0-69b0-41b7-90cb-dce8df0708d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:30 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Volume 70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a', 'volume_size': 1, 'snapshot_id': 'c2a5b403-8db1-4bda-9550-b674de597725'} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819" returned: 0 in 0.286s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:30 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.info Sep 08 14:06:30 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:30 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.info" returned: 0 in 0.241s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:30 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.info is being set with open permissions: ugo+rw Sep 08 14:06:30 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:30 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.info Sep 08 14:06:30 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:31 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.info" returned: 0 in 0.239s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168754618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f0977f-ba85-4b9a-a809-f866f5a46439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:29Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Creating volume 31f0977f-ba85-4b9a-a809-f866f5a46439 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:31 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:31 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 1073741824 Sep 08 14:06:31 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:31 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c4e11fe6-3055-43ac-a37e-e7d4db8894b5 tempest-ProjectReaderTests-842836332 None] Create snapshot completed successfully Sep 08 14:06:31 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 1073741824" returned: 0 in 0.408s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:31 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 Sep 08 14:06:31 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-5f1b0ea1-8a85-4266-a106-666ece014819-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Lock "cinder-5f1b0ea1-8a85-4266-a106-666ece014819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-214705a4-8a5f-49ae-a796-3ca980620254" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-214705a4-8a5f-49ae-a796-3ca980620254" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-5f1b0ea1-8a85-4266-a106-666ece014819" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-5f1b0ea1-8a85-4266-a106-666ece014819" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Deleting offline snapshot 5f1b0ea1-8a85-4266-a106-666ece014819 of volume 214705a4-8a5f-49ae-a796-3ca980620254 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] snapshot_file for this snap is: volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[876f0eb3-dd36-451d-9df8-fa526fe444ab]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:31 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439" returned: 0 in 0.249s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.222s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-quobyte-c2a5b403-8db1-4bda-9550-b674de597725-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" by "_create_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53023a12-0408-4898-bf0a-e5104b9e6066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f0977f-ba85-4b9a-a809-f866f5a46439', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e07dd7-c85c-4aa1-8f70-1e7d7b926471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-c2a5b403-8db1-4bda-9550-b674de597725-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Creating volume 70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a from snapshot c2a5b403-8db1-4bda-9550-b674de597725 {{(pid=87262) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-quobyte-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" by "_copy_volume_from_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] snapshot: c2a5b403-8db1-4bda-9550-b674de597725, volume: 70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a, {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 14:06:31 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Volume volume-31f0977f-ba85-4b9a-a809-f866f5a46439 (31f0977f-ba85-4b9a-a809-f866f5a46439): created successfully Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e07dd7-c85c-4aa1-8f70-1e7d7b926471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:31 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (8d64a250-a8bf-489b-88a6-d2ece61940a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:31 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 Sep 08 14:06:31 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:32 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8ee2a5fe-848a-4ee8-a2ec-4e449a356d2a tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afaf95e-d082-4bd5-9348-9bfd174965aa]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:32 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 Sep 08 14:06:32 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:32 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819" returned: 0 in 0.379s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-214705a4-8a5f-49ae-a796-3ca980620254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9863a70-19e5-4da5-b2f7-3e61554048eb]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:32 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 Sep 08 14:06:32 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:32 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725" returned: 0 in 0.382s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b0cf0d-2f9b-49a2-926c-aeffefadf292]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:32 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b Sep 08 14:06:32 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:32 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254" returned: 0 in 0.419s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:32 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 Sep 08 14:06:32 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:32 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" returned: 0 in 0.384s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Creating direct copy from snapshot {{(pid=87262) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG cinder.utils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Path /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a not found in is_blk_device check {{(pid=87262) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 14:06:32 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:32 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a Sep 08 14:06:32 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:33 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819" returned: 0 in 0.343s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:33 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819 Sep 08 14:06:33 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:33 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:33 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254.5f1b0ea1-8a85-4266-a106-666ece014819" returned: 0 in 0.296s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-5f1b0ea1-8a85-4266-a106-666ece014819" released by "_delete_snapshot" :: held 1.548s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-214705a4-8a5f-49ae-a796-3ca980620254" released by "delete_snapshot" :: held 1.581s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:33 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Created reservations ['473725e8-45a4-4d1e-8a25-a86e505a6087', '62b03cf1-2323-4991-9b12-2baba2203586', '9aef1282-e959-4088-9fb7-2cea6a68c0f7', '02b4fd54-09bf-4547-8122-d49d80daf643'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:33 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Delete snapshot completed successfully. Sep 08 14:06:33 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-bb08fb05-94fa-4fba-b5f0-3f8da0381826 tempest-ProjectReaderTests-842836332 None] Lock "cinder-5f1b0ea1-8a85-4266-a106-666ece014819-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-214705a4-8a5f-49ae-a796-3ca980620254-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Lock "cinder-214705a4-8a5f-49ae-a796-3ca980620254-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-214705a4-8a5f-49ae-a796-3ca980620254" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:34 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-214705a4-8a5f-49ae-a796-3ca980620254" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:34 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[02311b7d-f23c-4e13-84c7-8894d6b416d1]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:34 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 Sep 08 14:06:34 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:34 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254" returned: 0 in 0.660s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:34 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:34 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254 Sep 08 14:06:34 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:35 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-214705a4-8a5f-49ae-a796-3ca980620254" returned: 0 in 0.475s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-214705a4-8a5f-49ae-a796-3ca980620254" released by "delete_volume" :: held 1.306s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Created reservations ['7751ea04-3004-4799-b53e-374349cb1433', 'b94226d4-0d1b-4a69-a3c8-2a2a30601ce2', '476fbafa-df63-40ca-b096-fbeafaef55c3', '1996a178-a147-48c7-ae54-3baf21dee11f'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:35 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:35 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:35 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:36 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:36 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.361s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:36 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:36 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Deleted volume successfully. Sep 08 14:06:36 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-c85ab63a-34ff-4ac5-a3c1-caa7399b2668 tempest-ProjectReaderTests-842836332 None] Lock "cinder-214705a4-8a5f-49ae-a796-3ca980620254-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (2ef3421b-6a7a-4d2e-b2e6-0bd3495de4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb70dc81-2198-49b0-bfec-ef27eed9c92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb70dc81-2198-49b0-bfec-ef27eed9c92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653363213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01600b2-02fd-4d94-8238-3281efd6fa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:37Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857dc116-e43e-4a98-8c16-bb21cc7d3110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857dc116-e43e-4a98-8c16-bb21cc7d3110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6327177-897a-4621-a48d-ed343155aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6327177-897a-4621-a48d-ed343155aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd01600b2-02fd-4d94-8238-3281efd6fa65', 'volume_name': 'volume-d01600b2-02fd-4d94-8238-3281efd6fa65', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8675bb0-f2d6-46aa-8b3e-643b3f0b1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8675bb0-f2d6-46aa-8b3e-643b3f0b1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f34f20-1d1a-4222-905c-3f8906d0948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:37 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Volume d01600b2-02fd-4d94-8238-3281efd6fa65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d01600b2-02fd-4d94-8238-3281efd6fa65', 'volume_size': 1} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:37 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" returned: 0 in 4.845s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.image.image_utils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Image conversion details: src /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a {{(pid=87262) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 14:06:37 devstack cinder-volume[87262]: INFO cinder.image.image_utils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Converted 1024.00 MB image at 211.34 MB/s Sep 08 14:06:37 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a is being set with open permissions: ugo+rw Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:37 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a Sep 08 14:06:37 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:37 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" returned: 0 in 0.227s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" released by "_copy_volume_from_snapshot" :: held 5.942s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-c2a5b403-8db1-4bda-9550-b674de597725-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" released by "_create_volume_from_snapshot" :: held 6.007s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.035s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.232s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Creating offline snapshot 0852ddbb-54fb-47f5-b6f4-169fa42e4abc of volume 31f0977f-ba85-4b9a-a809-f866f5a46439 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83b69f0-69b0-41b7-90cb-dce8df0708d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a', 'volume_size': 1, 'snapshot_id': 'c2a5b403-8db1-4bda-9550-b674de597725'}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0bd8188-770e-48b9-8a82-a0d692b54e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a744013b-9851-4c99-b420-66a491a8f7e9]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:37 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:38 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Volume volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a (70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a): created successfully Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0bd8188-770e-48b9-8a82-a0d692b54e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Flow 'volume_create_manager' (2e1b73fa-aa1a-4a17-94ca-19484e340aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:38 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1a147ef7-6aa7-4bdd-b6ee-c2bbef8013e1 tempest-SnapshotDependencyTests-1867790592 None] Created volume successfully. Sep 08 14:06:38 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 Sep 08 14:06:38 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-c2a5b403-8db1-4bda-9550-b674de597725-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:38 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439" returned: 0 in 0.363s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-c2a5b403-8db1-4bda-9550-b674de597725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:38 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc 1G Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-quobyte-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:38 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-quobyte-c2a5b403-8db1-4bda-9550-b674de597725" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-c2a5b403-8db1-4bda-9550-b674de597725" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Deleting offline snapshot c2a5b403-8db1-4bda-9550-b674de597725 of volume ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] snapshot_file for this snap is: volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad49db70-b0dc-4065-8d70-82828b3a9f97]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:38 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 Sep 08 14:06:38 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:38 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc 1G" returned: 0 in 0.383s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f0977f-ba85-4b9a-a809-f866f5a46439 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:38 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f0977f-ba85-4b9a-a809-f866f5a46439 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc Sep 08 14:06:38 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:38 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725" returned: 0 in 0.371s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[af05b1d0-90a0-4670-b009-19b40b218f8a]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:38 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:38 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b Sep 08 14:06:38 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:39 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f0977f-ba85-4b9a-a809-f866f5a46439 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc" returned: 0 in 0.314s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:39 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc is being set with open permissions: ugo+rw Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:39 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc Sep 08 14:06:39 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:39 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc" returned: 0 in 0.270s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:39 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:39 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.info Sep 08 14:06:39 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" returned: 0 in 0.556s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:39 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 Sep 08 14:06:39 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:39 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.info" returned: 0 in 0.275s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:39 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.info is being set with open permissions: ugo+rw Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:39 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.info Sep 08 14:06:39 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:39 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725" returned: 0 in 0.325s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:39 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725 Sep 08 14:06:39 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:39 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.info" returned: 0 in 0.235s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.380s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653363213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01600b2-02fd-4d94-8238-3281efd6fa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:37Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Creating volume d01600b2-02fd-4d94-8238-3281efd6fa65 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:39 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:39 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 1073741824 Sep 08 14:06:39 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:39 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c6f489fd-44b0-4cd9-ac23-8d7cf1fa65f3 tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:06:39 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:39 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b.c2a5b403-8db1-4bda-9550-b674de597725" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-c2a5b403-8db1-4bda-9550-b674de597725" released by "_delete_snapshot" :: held 1.608s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" released by "delete_snapshot" :: held 1.630s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Created reservations ['f74e106d-0b7b-4d99-b1e1-6025ff5edc8a', '800086e2-44db-4bbf-81df-8a33ec99dd18', '7f20cd6c-3285-4008-bcc4-8eb0167fa30b', '3bc54b52-e99f-403d-a3e3-2bce4b2754bc'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-0852ddbb-54fb-47f5-b6f4-169fa42e4abc-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Lock "cinder-0852ddbb-54fb-47f5-b6f4-169fa42e4abc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-31f0977f-ba85-4b9a-a809-f866f5a46439" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-31f0977f-ba85-4b9a-a809-f866f5a46439" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-0852ddbb-54fb-47f5-b6f4-169fa42e4abc" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Delete snapshot completed successfully. Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-0852ddbb-54fb-47f5-b6f4-169fa42e4abc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot 0852ddbb-54fb-47f5-b6f4-169fa42e4abc of volume 31f0977f-ba85-4b9a-a809-f866f5a46439 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-365dc226-4177-4cbd-8529-b7dd431c2018 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-c2a5b403-8db1-4bda-9550-b674de597725-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f27c894-4745-43d5-be7b-c670fbe5a4b5]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:40 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc Sep 08 14:06:40 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:40 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 1073741824" returned: 0 in 0.561s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:40 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 Sep 08 14:06:40 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-quobyte-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" acquired by "delete_volume" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de2ee2-9a5a-4828-a59f-a385ff2cea7d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:40 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc" returned: 0 in 0.461s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31f0977f-ba85-4b9a-a809-f866f5a46439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7070a27-9543-40e3-b05f-7e5213a20d94]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:40 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65" returned: 0 in 0.284s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f34f20-1d1a-4222-905c-3f8906d0948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01600b2-02fd-4d94-8238-3281efd6fa65', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f46090-f714-4796-88e5-659775c89a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:40 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b Sep 08 14:06:40 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:40 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Volume volume-d01600b2-02fd-4d94-8238-3281efd6fa65 (d01600b2-02fd-4d94-8238-3281efd6fa65): created successfully Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f46090-f714-4796-88e5-659775c89a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:40 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (2ef3421b-6a7a-4d2e-b2e6-0bd3495de4f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:40 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-c9053a50-4872-4256-803a-76152bc9cc3d tempest-ProjectReaderTests-842836332 None] Created volume successfully. Sep 08 14:06:40 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 Sep 08 14:06:40 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:41 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" returned: 0 in 0.379s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:41 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b Sep 08 14:06:41 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:41 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439" returned: 0 in 0.365s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:41 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc Sep 08 14:06:41 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:41 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" returned: 0 in 0.253s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b" released by "delete_volume" :: held 0.718s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Created reservations ['3120deff-11d5-4bb5-92f7-df5febf5f99c', '4647703b-f2a9-4aab-b8e4-04dcab646f8f', '72b06797-b19b-4df1-b440-c2ae32d9ccba', 'f5925337-748f-45d9-892c-3633a9a04d5e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:41 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc" returned: 0 in 0.390s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:41 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:41 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:41 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc Sep 08 14:06:41 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:41 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.315s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:41 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Deleted volume successfully. Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:41 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439.0852ddbb-54fb-47f5-b6f4-169fa42e4abc" returned: 0 in 0.324s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-0852ddbb-54fb-47f5-b6f4-169fa42e4abc" released by "_delete_snapshot" :: held 1.672s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Creating offline snapshot a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 of volume d01600b2-02fd-4d94-8238-3281efd6fa65 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "cinder-quobyte-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ed00887c-cde5-4882-8f0b-81b1fa36b49b tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-ecc19d3d-73e9-4c7f-9ca1-644907b15f6b-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-31f0977f-ba85-4b9a-a809-f866f5a46439" released by "delete_snapshot" :: held 1.714s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d8dd78-5691-4e5e-bbdd-a1f62ea6665e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" acquired by "delete_volume" :: waited 0.033s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f81462-8898-43a2-96ca-fab72d27b58d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:41 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Created reservations ['898ad6f1-1222-4efd-a32b-834d5b76d029', 'd463ec82-57c0-42fd-ac68-7691f311eb27', 'dd0764aa-b2f8-4b3b-b542-8ab6de1d0e70', '774a69aa-dbcd-4bb0-9193-4dce32417b42'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:42 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 Sep 08 14:06:42 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:42 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:06:42 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a Sep 08 14:06:42 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-ef2830a6-8fcf-4ff4-8f15-8b9a2a6396ff tempest-ProjectMemberTests-837234304 None] Lock "cinder-0852ddbb-54fb-47f5-b6f4-169fa42e4abc-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-31f0977f-ba85-4b9a-a809-f866f5a46439-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Lock "cinder-31f0977f-ba85-4b9a-a809-f866f5a46439-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:42 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65" returned: 0 in 0.443s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:42 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:42 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 1G Sep 08 14:06:42 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" returned: 0 in 0.441s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-31f0977f-ba85-4b9a-a809-f866f5a46439" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:42 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a Sep 08 14:06:42 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-31f0977f-ba85-4b9a-a809-f866f5a46439" acquired by "delete_volume" :: waited 0.023s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[455807fc-b072-483c-a464-2e17c2b9c3bb]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:42 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 Sep 08 14:06:42 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:42 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" returned: 0 in 0.279s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-quobyte-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a" released by "delete_volume" :: held 0.762s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Created reservations ['73227919-deb7-4fa9-8d28-cee56acfc931', 'be6d4ae8-a918-4190-8f8d-102409dd3cc9', 'b0e8eb36-429d-44d5-a3fd-dbeff3d616fa', '7f75df87-7269-426a-9c3e-f7e989648691'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:42 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:42 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:42 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 1G" returned: 0 in 0.495s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01600b2-02fd-4d94-8238-3281efd6fa65 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:42 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01600b2-02fd-4d94-8238-3281efd6fa65 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 Sep 08 14:06:42 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:42 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439" returned: 0 in 0.439s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:42 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:42 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439 Sep 08 14:06:42 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:43 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.310s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:43 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Deleted volume successfully. Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-f4120e5b-11a9-4438-a870-e4d936061f42 tempest-SnapshotDependencyTests-1867790592 None] Lock "cinder-70cb8ee3-f9ff-4452-8a7e-e68d57f98e2a-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:43 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01600b2-02fd-4d94-8238-3281efd6fa65 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611" returned: 0 in 0.326s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:43 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 is being set with open permissions: ugo+rw Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:43 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 Sep 08 14:06:43 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:43 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-31f0977f-ba85-4b9a-a809-f866f5a46439" returned: 0 in 0.309s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-31f0977f-ba85-4b9a-a809-f866f5a46439" released by "delete_volume" :: held 0.831s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Created reservations ['4c9da573-b73b-4802-a0e0-0d03dec5c02a', 'ec8cc04a-b422-4f18-af80-75d103a0d9d1', '2ca6ef5f-136f-4890-a92e-d4f378070925', '5b431c0e-f479-485e-83a3-b92c35735129'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:43 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:43 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:43 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:43 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.info Sep 08 14:06:43 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:43 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.328s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:43 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f28c572-7f44-4aa5-bfe6-4626e411a699 tempest-ProjectMemberTests-837234304 None] Lock "cinder-31f0977f-ba85-4b9a-a809-f866f5a46439-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:43 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.info" returned: 0 in 0.448s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:43 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.info is being set with open permissions: ugo+rw Sep 08 14:06:43 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:44 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.info Sep 08 14:06:44 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (52dec2c3-3f69-4d9f-b7c4-0fd7e8b795fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d939e0-e6a7-495d-ae6c-81f2a0141908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d939e0-e6a7-495d-ae6c-81f2a0141908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1638470558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05462d1-7242-4aba-a352-bd41155b5cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:44Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d748ac8d-e7cc-4bfd-9077-19f17d387b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d748ac8d-e7cc-4bfd-9077-19f17d387b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296f38f9-e0ee-4797-b457-8385989cae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296f38f9-e0ee-4797-b457-8385989cae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05462d1-7242-4aba-a352-bd41155b5cd0', 'volume_name': 'volume-f05462d1-7242-4aba-a352-bd41155b5cd0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee8159d-fc13-4558-80bf-e18dbb924d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee8159d-fc13-4558-80bf-e18dbb924d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfe7e96-c621-453f-bad5-f73f195cd565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:44 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Volume f05462d1-7242-4aba-a352-bd41155b5cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05462d1-7242-4aba-a352-bd41155b5cd0', 'volume_size': 1} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:44 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.info" returned: 0 in 0.316s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.088s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1638470558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05462d1-7242-4aba-a352-bd41155b5cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:44Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Creating volume f05462d1-7242-4aba-a352-bd41155b5cd0 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:44 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:44 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 1073741824 Sep 08 14:06:44 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:44 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-75184a9f-9c84-472f-b11a-696e085e3616 tempest-ProjectReaderTests-842836332 None] Create snapshot completed successfully Sep 08 14:06:44 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 1073741824" returned: 0 in 0.500s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:44 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:44 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 Sep 08 14:06:44 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Lock "cinder-a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-d01600b2-02fd-4d94-8238-3281efd6fa65" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:45 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-d01600b2-02fd-4d94-8238-3281efd6fa65" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0" returned: 0 in 0.279s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfe7e96-c621-453f-bad5-f73f195cd565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05462d1-7242-4aba-a352-bd41155b5cd0', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112cc7b8-a475-428d-b5dc-4e55168b4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Deleting offline snapshot a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 of volume d01600b2-02fd-4d94-8238-3281efd6fa65 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] snapshot_file for this snap is: volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d941de-35e8-40f9-8076-23597339c893]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:45 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Volume volume-f05462d1-7242-4aba-a352-bd41155b5cd0 (f05462d1-7242-4aba-a352-bd41155b5cd0): created successfully Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112cc7b8-a475-428d-b5dc-4e55168b4123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (52dec2c3-3f69-4d9f-b7c4-0fd7e8b795fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:45 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-fe89730a-9ae1-46c5-9c77-5c6e50beb245 tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:06:45 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 Sep 08 14:06:45 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:45 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611" returned: 0 in 0.409s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01600b2-02fd-4d94-8238-3281efd6fa65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d06a788-ab2d-464f-8447-c651657d9143]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:45 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:45 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 Sep 08 14:06:45 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:46 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65" returned: 0 in 0.416s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:46 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 Sep 08 14:06:46 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Creating offline snapshot 853f8500-8169-4e4d-8df7-901c0f71dd78 of volume f05462d1-7242-4aba-a352-bd41155b5cd0 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:46 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611" returned: 0 in 0.403s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[120c6821-545b-4b9c-8d79-c41d9eabf71b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:46 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611 Sep 08 14:06:46 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:46 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 Sep 08 14:06:46 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:46 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65.a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611" returned: 0 in 0.292s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611" released by "_delete_snapshot" :: held 1.610s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-d01600b2-02fd-4d94-8238-3281efd6fa65" released by "delete_snapshot" :: held 1.650s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:46 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0" returned: 0 in 0.370s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:46 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 1G Sep 08 14:06:46 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Created reservations ['51f2d9aa-87fb-4f8a-b6f0-8a4bb6f7d44f', '8fc4cd10-ba62-4a80-b3ee-8a8cd9ec7f1a', '23316db9-7336-4b64-8e0a-e9b71aaa25bd', 'a82be1d6-71f5-4b70-9841-449e991f18a4'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:46 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Delete snapshot completed successfully. Sep 08 14:06:46 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-4f3754a1-6af1-4a6f-97ca-ac3f841dd01c tempest-ProjectReaderTests-842836332 None] Lock "cinder-a4f75cbd-bd5c-4015-af9b-fc2a1e6f4611-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:47 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-d01600b2-02fd-4d94-8238-3281efd6fa65-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 1G" returned: 0 in 0.431s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05462d1-7242-4aba-a352-bd41155b5cd0 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Lock "cinder-d01600b2-02fd-4d94-8238-3281efd6fa65-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:47 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05462d1-7242-4aba-a352-bd41155b5cd0 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 Sep 08 14:06:47 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-d01600b2-02fd-4d94-8238-3281efd6fa65" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-d01600b2-02fd-4d94-8238-3281efd6fa65" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009d282-e982-4c7f-9d6c-242a3dbfb65b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:47 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 Sep 08 14:06:47 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:47 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05462d1-7242-4aba-a352-bd41155b5cd0 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78" returned: 0 in 0.425s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:47 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 is being set with open permissions: ugo+rw Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:47 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 Sep 08 14:06:47 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:47 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65" returned: 0 in 0.425s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:47 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:47 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65 Sep 08 14:06:47 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:47 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78" returned: 0 in 0.290s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:48 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.info Sep 08 14:06:48 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:48 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-d01600b2-02fd-4d94-8238-3281efd6fa65" returned: 0 in 0.253s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-d01600b2-02fd-4d94-8238-3281efd6fa65" released by "delete_volume" :: held 0.811s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Created reservations ['a32ce0bd-1c97-455d-a60c-3f5c791fe1b5', '3ee5979f-31cb-43e0-8d9d-c98a99869cd2', 'eca8ebf7-9f04-44e6-bb1f-e034ada6cf3e', '8a8a55bc-4825-426c-8369-ce3208728908'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:48 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.info" returned: 0 in 0.329s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:48 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.info is being set with open permissions: ugo+rw Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:48 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:48 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:48 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.info Sep 08 14:06:48 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:48 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.328s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Deleted volume successfully. Sep 08 14:06:48 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.info" returned: 0 in 0.343s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:48 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-8c787c6e-f69e-43d9-b641-3942f16b2f9d tempest-ProjectReaderTests-842836332 None] Lock "cinder-d01600b2-02fd-4d94-8238-3281efd6fa65-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:48 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-41b2086f-b9b3-4e09-87f1-baa73265e883 tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:UPDATE=240,cinder:SELECT=191,cinder:INSERT=65,cinder:DELETE=20 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:DELETE=22,cinder:SELECT=172,cinder:UPDATE=234,cinder:INSERT=61 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (bb474cd6-d00c-41fe-a81f-c18901fae313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cb0eae-3a29-4e48-8567-07a64a085d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cb0eae-3a29-4e48-8567-07a64a085d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542087918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7d7b6d-e62b-4350-a268-2b9563f39956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:49Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132754c6-8637-436d-b5db-fbd772283fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132754c6-8637-436d-b5db-fbd772283fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eaca658-ef77-40e6-8ff2-3d9b94b1752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eaca658-ef77-40e6-8ff2-3d9b94b1752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7d7b6d-e62b-4350-a268-2b9563f39956', 'volume_name': 'volume-df7d7b6d-e62b-4350-a268-2b9563f39956', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09607d10-3267-4ba2-980e-a75005a92dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09607d10-3267-4ba2-980e-a75005a92dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7d80ab-4e84-4234-bddb-6c96bf6e47f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:49 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Volume df7d7b6d-e62b-4350-a268-2b9563f39956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7d7b6d-e62b-4350-a268-2b9563f39956', 'volume_size': 1} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542087918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7d7b6d-e62b-4350-a268-2b9563f39956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90edf4f1f4d64377846d8f1b102fe495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:49Z,use_quota=True,user_id='68bb54ce6a574b90b75c942ebb9bb665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Creating volume df7d7b6d-e62b-4350-a268-2b9563f39956 {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:49 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:49 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 1073741824 Sep 08 14:06:49 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:49 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 1073741824" returned: 0 in 0.469s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-853f8500-8169-4e4d-8df7-901c0f71dd78-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Lock "cinder-853f8500-8169-4e4d-8df7-901c0f71dd78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-f05462d1-7242-4aba-a352-bd41155b5cd0" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-f05462d1-7242-4aba-a352-bd41155b5cd0" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-853f8500-8169-4e4d-8df7-901c0f71dd78" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:49 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 Sep 08 14:06:49 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-853f8500-8169-4e4d-8df7-901c0f71dd78" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot 853f8500-8169-4e4d-8df7-901c0f71dd78 of volume f05462d1-7242-4aba-a352-bd41155b5cd0 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9169498-ef69-403d-9c2d-148bc48af959]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:49 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:49 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 Sep 08 14:06:49 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:50 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956" returned: 0 in 0.304s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7d80ab-4e84-4234-bddb-6c96bf6e47f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7d7b6d-e62b-4350-a268-2b9563f39956', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40a91dd-99c0-4f8e-b9dc-032276377dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:50 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Volume volume-df7d7b6d-e62b-4350-a268-2b9563f39956 (df7d7b6d-e62b-4350-a268-2b9563f39956): created successfully Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40a91dd-99c0-4f8e-b9dc-032276377dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Flow 'volume_create_manager' (bb474cd6-d00c-41fe-a81f-c18901fae313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:50 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-50ca3bd7-3da3-42ba-aeac-d93a4befed3f tempest-ProjectReaderTests-842836332 None] Created volume successfully. Sep 08 14:06:50 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78" returned: 0 in 0.391s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f05462d1-7242-4aba-a352-bd41155b5cd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[903349b6-914b-48b7-af9e-ec7f57a6a03c]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:50 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 Sep 08 14:06:50 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:50 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0" returned: 0 in 0.360s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:50 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 Sep 08 14:06:50 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:50 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78" returned: 0 in 0.330s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:50 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:50 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78 Sep 08 14:06:50 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:51 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0.853f8500-8169-4e4d-8df7-901c0f71dd78" returned: 0 in 0.291s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-853f8500-8169-4e4d-8df7-901c0f71dd78" released by "_delete_snapshot" :: held 1.500s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-f05462d1-7242-4aba-a352-bd41155b5cd0" released by "delete_snapshot" :: held 1.528s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Created reservations ['18377fb8-8893-4ae1-84f7-2e679f800989', '304b4288-274e-4836-a437-d876ebe6b53c', '69ea5151-ea75-4492-9135-cbc0c8b8011c', 'def3b639-3987-489a-9171-180a9b734a2b'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:51 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Creating offline snapshot a53bbb1b-0f1e-4197-9382-02bd3fb051e1 of volume df7d7b6d-e62b-4350-a268-2b9563f39956 {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-492b13f3-2d42-4247-85d5-8d6897ef5d88 tempest-ProjectMemberTests-837234304 None] Lock "cinder-853f8500-8169-4e4d-8df7-901c0f71dd78-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f071cb-202a-4dc5-8b46-2d308ac6c20d]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:51 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 Sep 08 14:06:51 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:51 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956" returned: 0 in 0.362s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:51 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 1G Sep 08 14:06:51 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-f05462d1-7242-4aba-a352-bd41155b5cd0-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Lock "cinder-f05462d1-7242-4aba-a352-bd41155b5cd0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-f05462d1-7242-4aba-a352-bd41155b5cd0" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-f05462d1-7242-4aba-a352-bd41155b5cd0" acquired by "delete_volume" :: waited 0.019s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[2291a9a6-fa56-4b28-bca0-3c214a40d0c2]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:51 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:52 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 Sep 08 14:06:52 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:52 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 1G" returned: 0 in 0.485s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7d7b6d-e62b-4350-a268-2b9563f39956 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:52 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7d7b6d-e62b-4350-a268-2b9563f39956 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 Sep 08 14:06:52 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:52 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0" returned: 0 in 0.476s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:52 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0 Sep 08 14:06:52 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:52 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7d7b6d-e62b-4350-a268-2b9563f39956 -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1" returned: 0 in 0.324s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:52 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 is being set with open permissions: ugo+rw Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:52 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 Sep 08 14:06:52 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:52 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-f05462d1-7242-4aba-a352-bd41155b5cd0" returned: 0 in 0.278s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-f05462d1-7242-4aba-a352-bd41155b5cd0" released by "delete_volume" :: held 0.822s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Created reservations ['6ba5b9a8-59a6-40e1-8a5e-2f7258722156', 'd8c0f80b-e51d-4a50-96e0-eaef55b380ad', 'a4f4edef-7455-4650-bbfc-a82b0bd6aeed', 'dc4deaec-a7f4-4629-9b30-0705d4808ba7'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:52 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1" returned: 0 in 0.265s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:52 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:52 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:52 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:52 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.info Sep 08 14:06:52 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:53 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.385s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:53 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:06:53 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.info" returned: 0 in 0.358s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:53 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.info is being set with open permissions: ugo+rw Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e7489d4f-6528-4033-a8c7-ff713f9c9722 tempest-ProjectMemberTests-837234304 None] Lock "cinder-f05462d1-7242-4aba-a352-bd41155b5cd0-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:53 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.info Sep 08 14:06:53 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:53 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.info" returned: 0 in 0.305s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.210s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87262) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (3460dc23-c2d2-4bf6-a48b-6b1633e36fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e355e7a9-cf2c-4572-b333-eaa5686c5e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:53 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-8c76e770-b200-4f87-bc32-a17718280497 tempest-ProjectReaderTests-842836332 None] Create snapshot completed successfully Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e355e7a9-cf2c-4572-b333-eaa5686c5e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717075500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fab57d-f05a-4b22-9b86-174e15c7ce1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:54Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9448f2e-013c-4da2-8b0d-83e14b1c5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9448f2e-013c-4da2-8b0d-83e14b1c5130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3fcbbe8-67c0-4710-b308-c8cac8236391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3fcbbe8-67c0-4710-b308-c8cac8236391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45fab57d-f05a-4b22-9b86-174e15c7ce1b', 'volume_name': 'volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76601cb8-2185-4f7f-83b5-67553626b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76601cb8-2185-4f7f-83b5-67553626b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0d3e45-c9ca-4b5b-a961-d3b6f7371dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:53 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Volume 45fab57d-f05a-4b22-9b86-174e15c7ce1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b', 'volume_size': 1} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T12:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717075500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fab57d-f05a-4b22-9b86-174e15c7ce1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6284fa796a0c4fdf8f4500d0e10283c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T12:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T12:06:54Z,use_quota=True,user_id='ad036929cedf48559398cc9214bea545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710f313a-0e93-4eb2-9101-fcb7e0dafdb8),volume_type_id=710f313a-0e93-4eb2-9101-fcb7e0dafdb8)}" {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Creating volume 45fab57d-f05a-4b22-9b86-174e15c7ce1b {{(pid=87262) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Selected osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 as target Quobyte volume. {{(pid=87262) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 14:06:53 devstack cinder-volume[87262]: INFO cinder.volume.drivers.remotefs [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] casted to osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7 Sep 08 14:06:53 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b 1073741824 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:53 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b 1073741824 Sep 08 14:06:53 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:54 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b 1073741824" returned: 0 in 0.462s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:54 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b Sep 08 14:06:54 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:54 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b" returned: 0 in 0.245s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'} {{(pid=87262) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0d3e45-c9ca-4b5b-a961-d3b6f7371dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b', 'volume_size': 1}' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205eb5b0-9675-433c-9b32-43641369945a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 14:06:54 devstack cinder-volume[87262]: INFO cinder.volume.flows.manager.create_volume [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Volume volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b (45fab57d-f05a-4b22-9b86-174e15c7ce1b): created successfully Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205eb5b0-9675-433c-9b32-43641369945a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87262) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Flow 'volume_create_manager' (3460dc23-c2d2-4bf6-a48b-6b1633e36fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87262) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 14:06:54 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-4c4b5e6e-9ec1-44c6-93fc-e3e4c71cefb5 tempest-ProjectMemberTests-837234304 None] Created volume successfully. Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-a53bbb1b-0f1e-4197-9382-02bd3fb051e1-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Lock "cinder-a53bbb1b-0f1e-4197-9382-02bd3fb051e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-df7d7b6d-e62b-4350-a268-2b9563f39956" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-df7d7b6d-e62b-4350-a268-2b9563f39956" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-a53bbb1b-0f1e-4197-9382-02bd3fb051e1" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-a53bbb1b-0f1e-4197-9382-02bd3fb051e1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Deleting offline snapshot a53bbb1b-0f1e-4197-9382-02bd3fb051e1 of volume df7d7b6d-e62b-4350-a268-2b9563f39956 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] snapshot_file for this snap is: volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a39566-5581-4e61-b6eb-366f15df73d2]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:54 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:54 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 Sep 08 14:06:54 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:55 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1" returned: 0 in 0.426s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df7d7b6d-e62b-4350-a268-2b9563f39956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2659c5a-f142-4cd6-b474-488074edef4b]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:55 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 Sep 08 14:06:55 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:55 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956" returned: 0 in 0.357s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:55 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 Sep 08 14:06:55 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:55 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1" returned: 0 in 0.334s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:55 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1 Sep 08 14:06:55 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Creating offline snapshot 1a206b84-c6db-4943-92e3-ce4fead915fc of volume 45fab57d-f05a-4b22-9b86-174e15c7ce1b {{(pid=87262) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[4489dfb5-f081-430b-8c3b-2a74928e4dff]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:55 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:56 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b Sep 08 14:06:56 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:56 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956.a53bbb1b-0f1e-4197-9382-02bd3fb051e1" returned: 0 in 0.237s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-a53bbb1b-0f1e-4197-9382-02bd3fb051e1" released by "_delete_snapshot" :: held 1.457s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-df7d7b6d-e62b-4350-a268-2b9563f39956" released by "delete_snapshot" :: held 1.481s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Created reservations ['9cc1d10c-70d1-488f-b6f2-e013327db99f', 'a2195d30-6c5a-4366-9651-95765841eb79', '72e6f87f-ca60-40e4-806e-51107868d950', '10756567-8e43-4e79-9885-109b6686ee5e'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:56 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Delete snapshot completed successfully. Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-647a34d2-4e4a-41f7-afeb-01080e7a3467 tempest-ProjectReaderTests-842836332 None] Lock "cinder-a53bbb1b-0f1e-4197-9382-02bd3fb051e1-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:56 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b" returned: 0 in 0.367s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc 1G {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:56 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc 1G Sep 08 14:06:56 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:56 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc 1G" returned: 0 in 0.350s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:56 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc Sep 08 14:06:56 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-df7d7b6d-e62b-4350-a268-2b9563f39956-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Lock "cinder-df7d7b6d-e62b-4350-a268-2b9563f39956-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Acquiring lock "cinder-quobyte-df7d7b6d-e62b-4350-a268-2b9563f39956" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-df7d7b6d-e62b-4350-a268-2b9563f39956" acquired by "delete_volume" :: waited 0.016s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[3631cb4d-5d6f-481a-8dd3-2efb721d618e]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:56 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b -F qcow2 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc" returned: 0 in 0.296s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:56 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc is being set with open permissions: ugo+rw Sep 08 14:06:56 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:56 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc Sep 08 14:06:56 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:56 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 Sep 08 14:06:57 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:57 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc" returned: 0 in 0.238s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:57 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.info Sep 08 14:06:57 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:57 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956" returned: 0 in 0.372s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:57 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956 Sep 08 14:06:57 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:57 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.info" returned: 0 in 0.259s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:57 devstack cinder-volume[87262]: WARNING cinder.volume.drivers.remotefs [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.info is being set with open permissions: ugo+rw Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.info {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:57 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.info Sep 08 14:06:57 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:57 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-df7d7b6d-e62b-4350-a268-2b9563f39956" returned: 0 in 0.252s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Lock "cinder-quobyte-df7d7b6d-e62b-4350-a268-2b9563f39956" released by "delete_volume" :: held 0.682s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Created reservations ['1f1644e3-1bad-4049-b8fe-67603e27bffa', 'cbca44df-fa80-43da-a124-c9970c2f5f30', '74186270-7398-4aec-b5e7-35ec66c33448', '72306d96-aef1-4ec2-87f6-d0f989c83187'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:57 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:06:57 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:57 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.info" returned: 0 in 0.249s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:06:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-58ed3ae2-e0ab-43ba-a8cb-578277e847b5 tempest-ProjectMemberTests-837234304 None] Create snapshot completed successfully Sep 08 14:06:57 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.247s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:06:57 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Deleted volume successfully. Sep 08 14:06:57 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-d842d1fe-35b9-48ce-b470-b4f11b1f5c72 tempest-ProjectReaderTests-842836332 None] Lock "cinder-df7d7b6d-e62b-4350-a268-2b9563f39956-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-1a206b84-c6db-4943-92e3-ce4fead915fc-delete_snapshot" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Lock "cinder-1a206b84-c6db-4943-92e3-ce4fead915fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-45fab57d-f05a-4b22-9b86-174e15c7ce1b" by "delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-45fab57d-f05a-4b22-9b86-174e15c7ce1b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-1a206b84-c6db-4943-92e3-ce4fead915fc" by "_delete_snapshot" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-1a206b84-c6db-4943-92e3-ce4fead915fc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Deleting offline snapshot 1a206b84-c6db-4943-92e3-ce4fead915fc of volume 45fab57d-f05a-4b22-9b86-174e15c7ce1b {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] snapshot_file for this snap is: volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc {{(pid=87262) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd656e86-63f7-4f18-80ef-6ea21ca9a418]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:58 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc Sep 08 14:06:58 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:58 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc" returned: 0 in 0.363s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.remotefs [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87262) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[76de84f5-dddd-47eb-8d42-951ec665ee28]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:58 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b Sep 08 14:06:58 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:58 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b" returned: 0 in 0.383s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:58 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:59 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc Sep 08 14:06:59 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:59 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc" returned: 0 in 0.361s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:06:59 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc Sep 08 14:06:59 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:06:59 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 08 14:06:59 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b.1a206b84-c6db-4943-92e3-ce4fead915fc" returned: 0 in 0.254s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:06:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-1a206b84-c6db-4943-92e3-ce4fead915fc" released by "_delete_snapshot" :: held 1.452s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-45fab57d-f05a-4b22-9b86-174e15c7ce1b" released by "delete_snapshot" :: held 1.477s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:06:59 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Created reservations ['864672a3-56d4-42cf-b50b-d16f42401c7f', 'e444af76-cd79-48fd-8175-4e0faf3f3230', 'd300021b-22a1-4c71-8d3e-7127aaa1c261', '6c7f3bc4-fee6-498f-b618-09fabd46d5be'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:06:59 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Delete snapshot completed successfully. Sep 08 14:06:59 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-e3ad8b4a-8d71-4b2e-aa31-1acd724628a4 tempest-ProjectMemberTests-837234304 None] Lock "cinder-1a206b84-c6db-4943-92e3-ce4fead915fc-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:07:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-45fab57d-f05a-4b22-9b86-174e15c7ce1b-delete_volume" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:07:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Lock "cinder-45fab57d-f05a-4b22-9b86-174e15c7ce1b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:07:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Acquiring lock "cinder-quobyte-45fab57d-f05a-4b22-9b86-174e15c7ce1b" by "delete_volume" {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 14:07:00 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-45fab57d-f05a-4b22-9b86-174e15c7ce1b" acquired by "delete_volume" :: waited 0.018s {{(pid=87262) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 14:07:00 devstack cinder-volume[87262]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4313cdb-9e00-486f-af61-9aaad9986749]: (4, 'qcow2') {{(pid=88891) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 14:07:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:07:00 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b Sep 08 14:07:00 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:07:00 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 08 14:07:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b" returned: 0 in 0.372s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:07:00 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:07:00 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b Sep 08 14:07:00 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:07:01 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52/volume-45fab57d-f05a-4b22-9b86-174e15c7ce1b" returned: 0 in 0.247s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Lock "cinder-quobyte-45fab57d-f05a-4b22-9b86-174e15c7ce1b" released by "delete_volume" :: held 0.684s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG cinder.quota [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Created reservations ['180eb468-8e6d-40f6-ae42-911fc804141e', 'dad95359-5ef0-43d6-bbe2-b7b31af1539b', '9cba2109-86a8-4e35-962d-52988838cf4b', '843ac61d-0773-418e-b73d-e3f084344e96'] {{(pid=87262) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:07:01 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:07:01 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:07:01 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.264s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:07:01 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Deleted volume successfully. Sep 08 14:07:01 devstack cinder-volume[87262]: DEBUG cinder.coordination [None req-a15062af-9dc5-49f5-9e0f-0524674a8eef tempest-ProjectMemberTests-837234304 None] Lock "cinder-45fab57d-f05a-4b22-9b86-174e15c7ce1b-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87262) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7': None} {{(pid=87262) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG cinder.volume.drivers.quobyte [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c9944965-07ad-42a5-94ad-d38b360290b7'] {{(pid=87262) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87262) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 14:07:03 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52 Sep 08 14:07:03 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 14:07:03 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG oslo_concurrency.processutils [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/152c461ad62e47f846643fece9046b52" returned: 0 in 0.292s {{(pid=87262) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG cinder.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Notifying Schedulers of capabilities ... {{(pid=87262) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG oslo_service.periodic_task [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] Running periodic task VolumeManager._thread_info {{(pid=87262) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread count: 29 {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 14:07:03 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-42fdfd16-3085-4db7-b2ad-9cc76fb13740 None None] thread info: [<_MainThread(MainThread, started 132850472071296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87262) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 14:07:11 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=38,cinder:UPDATE=48,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 14:07:11 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=36,cinder:UPDATE=50,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}